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NEEDED RESEARCH IN DIAGNOSING PERSONALITY 
AND CONDUCT 
PERCIVAL M. SYMONDS 
Teachers College, Columbia University 
[HE measurement movement in recent years has broadened out so 
s to include not only the measurement of intelligence and achievement, 
lso the non-intellectual qualities and characteristics variously known 
character, conduct, traits, personality, emotionality, ete. At the pres- 
t time, there is intense interest in these newer developmnets and much 
ellent work has been done. But in some directions this movement has 
rogressed further than it has in other directions. 
In a review of the present status of the development of measuring 


d diagnosing personality and conduct, a number of pressing questions 


were revealed which are still without definite answers,’ and there is need 


much patient comparison and checking which will refine and polish 


ethods which have been barely opened up. For instance, in the de- 


velopment of instruments of testing there have been noteworthy accom- 


shments, whereas in checking up on the reliability of the various 


I 


methods and devices much remains to be done. Questions have been 


ed on tests and questionnaires with little consideration of the best 


form; tests and questionnaires have been named without a full check 


the validity of the relationship between that which is measured and 


that which is named. 


Likewise, in general, there is only dim realization of the practical 
sibilities in using these measures to help individuals in distress, and 
inderstand the effects of many of our educational procedures. We 
re ready now to obtain accurate knowledge of the ‘‘concomitant out 
es’ of education, as they have been called by Kilpatrick. Diagnostic 


hniques of personality and conduct should be tried out in vocational 


A book to he published in January, 1932, by the Century Company entitled 
sing Personality and Conduct. 
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selection. Studies of the extent to which emotions are aroused in various 
situations, both in school and out, need to be made 

In the following list of problems needing solution are many wi 
have already been studied. They are included, not because the existing 
tigations are not sufficient, but because there is ample room 
verification of previous studies and for new studies under different co 
ditions and with different controls in which the influence of small \ 
tions in the situation are noted. As one instrument becomes perfect 
e signal for the repetition of an older experiment which was w 


taken with eruder and less accurate tests and measures 


lt reviewing the various problems which have been assembled 


ippears a regularity in the type of question. The same issue arises 


} 


1 agai new fields and with new materials. These may be gr 


into the following fourteen categories which represent the main typ 


roblems which demand investigation in the diagnosis of personalit 


How reliable is a test. questionnaire, or other device for securime 


rormatior ré varding pe rsonality and conduet ? 


What conditiens affect reliability 


How valid is a test, questionnaire, or other device for securing inf 
tion regarding personality and conduct? 

What is the effect of changing some elements of the situation in any 
of the diagnostic techniques considered? What is the influen: 
various factors on test results? 

What is the relation between various measures and estimates of pers 


ality, conduct, emotion, ete 


What are the possibilities for improving the various diagnostic te 


What qualities are necessary for suecess in the investigation ? 

The development of new tests, questionnaires, and other devices 

What is the distribution within a group of amounts of a trait, interest 
attitude, adjustment, ete.? 

The problem of framing items, questions, ete. 

The problem of selecting items 

The problem of weighting items 

The probl m of scoring. 


Differences between groups—sex. age, race, grade, environment, ¢ 
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A List or ProBLEMS NEEDING INVESTIGATION IN DIAGNOSING 
PERSONALITY AND CONDUCT 
OBSERVATION 

Sting |. How reliable are the various types of records, diaries, ete., for re- 

1 for cording observation ? 

CUr 2» How many children can be observed simultaneously by one person 

without loss of reliability? 

et }. How does the entry of the observer into the situation as a tester 

yr questioner affect the validity of observation ? 

t. Is the presence of the observer a disturbing element in observation ? 
How serious is this factor? How long does it persist? To what 
extent does it depend on the observer? On the situation? 

iped ). What is the relation of reliability of observation to the definition 

of the item to be observed ? 
6. What is the relation of reliability of observation to the number of 
tems being observed at a given time? 

What is the relation of reliability of observation to the subjectivity 

of the trait to be rated? 

8. How is the reliability of observation influenced by the spacing of 

observations over varying periods of time? 

) What is the relation of the time interval unit of observation to the 
quality or behavior observed? What are the optimum time units 
for observing different qualities, or types of behavior? 

10. What is the validity of observation schedules when prepared by 
different techniques? 

11. How is the reliability of a directed observation as conditioned by 
knowledge of, or understanding of the prepared schedule? 

12. What is the relation of a person’s own behavior or skills to ability 
in carrying out a finding observation? Is the person whose skill is 
most highly developed best able to observe others? 

13. What is the relation of a person’s knowledge to ability in carrying 


st out a finding observation? Is the person who has the most knowl- 
edge of a field best able to carry out a finding observation in that 
fit ld ? 


14. How does observation of human behavior and qualities under ex- 
eitement compare with observation when calm? 

15. How reliably ean behavior be interpreted? How accurate are 
interpretations from observation of human qualities, motives, and 
the like? How accurately does observation indicate traits or be- 





havior trends? 














16. 


30 
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How accurate is the memory in the observation of human qualities 
and behavior? 

What is the possibility of improvement in accuracy of observation 
of human qualities? 

What qualities in the individual are requisite for effective observa. 
tion under various conditions ? 

Development of the techniques of observation in the classroom. 


RATING METHODS 
[Is the halo effect primarily a matter of traits being rated, of th 
individuals doing the rating, or of the individuals being rated? 
What is the relative influence of the acquaintance factor to other 
factors? 
What is the relative influence of overestimation to other factors 
self-rating? 
What is the relation between intelligence and rating various tr: 
in different situations? 
When does the ‘‘altruism’’ factor operate in rating? 
The less than perfect correlation between ratings and the true values 
of the qualities being rated lead to various regressions which result 
in over and underestimates. What are the various regressions t! 
are found in connection with ratings? 
Is there any relationship between extreme ratings in estimating ou! 
selves and our personality adjustments? 
What traits do we tend to overestimate in ourselves? 
Is there more agreement in the upper end of the rating scale or 
the lower end of the scale for various traits. 
What are the characteristics of the good judge of others? 
How does self-rating compare in reliability with the rating 
others? 
How does acquaintance affect the reliability of ratings? What ar 


the conditions under which the ‘‘ acquaintance factor’’ operates? 
Will more extensive definitions or illustrations of the steps of a 
rating scale result in better rating? 

Is a general trait more reliably rated than a specific trait? 
Does the composite of the rating of several qualities into whic! 
trait has been analyzed result in higher reliability than to rate t! 
trait singly ? 

Which is more valid and reliable,—to rate one individual at a tim: 





or to rate one trait at a time? 





No.8 


; 
iON 
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Does the sum of ratings of responses in several situations correlate 
well with the rating on the trait which these situations represent ? 
How do ratings of traits and ratings of habits compare as to validity 
and reliability ? 
Can raters be trained so as to improve in their ability to rate? 
How much does a period of observation increase the reliability of 
ratings? 

THE QUESTIONNAIRE 
What is the form of the distribution of interests? 
What is the form of the distribution of attitudes? 
What is the relation between the reliability of a psychological ques- 
tionnaire and intelligence of the group answering it? 
How shall items be weighted in a psychological questionnaire? 
What added advantage does weighting yield over weighting all 
items equally? 
What is the most advantageous scoring method when the answer 
to each question has been placed on a graphic rating scale? 
How does reliability as determined by correlating two halves of a 
psychological questionnaire compare with the reliability as deter- 
mined by a retest? 
An analysis of the phenomenon known as ‘‘ weighting the probabk 
error’’ as when one validates a test and determines the scoring key 
on the same group in which he selects his items. 
Is the correlation of recalled experience with present adjustment 
due to the true relation between these past experiences and present 
adjustment or because the same present forces make a person act 
and say things that are related ? 
What is the optimum number of alternate responses in the answers 
to a psychological questionnaire? Is this related to the number of 
items in the questionnaire ? 
How should psychological questionnaires be interpreted and scored 
when items have been omitted? 
How does the true-false or yes-no question compare with questions 
which permit three or more degrees of judgment? 
To what extent are the errors in a psychological questionnaire con- 
stant or variable errors? 
To what extent does self-interest cause questionnaires to be an- 


swered falsely ? 
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lo what extent are individuals able to recall correctly their 


past experience over carrying intervals of time? 


l'o what extent are individuals able to observe their own acts? 
To what extent is suggestion a force in the answers given i: 
oral interview as compared with a standardized questionnaire ? 
To what extent does the interview involve bias on the part of t! 
examiner as compared with the standardized questionnaire ? 

W hat difference does a knowledge of the purpose ot a psycholog 
questionnaire make on the part of the person answering it? 

The development of an interest questionnaire for girls, to be us 
for determining girl’s choice of curriculum in the high schoo! 
What is the value of positive Statements as compared with negat 
statements? 

THE ADJUSTMENT QUESTIONNAIRE 

What are the relations of measures of ascendency-submissio1 
sex, age, occupation, race, scholarship, leadership, intelligence, et 
What are the relations of measures of introversion-extroversio! 
sex, age occupation, race, scholarship, intelligence, leadership el 
What are the relations of measures of psycho-neurotie tende1 
to sex, age, occupation, race, scholarship, intelligence, ete. ? 

What is the relation of introversion-extroversion questionnaires 
observation of behavior as indicative of introversion-extroversio! 
What types of maladjustment are found under varying condition 

nd in varying circumstances as shown by various forms of ad} 
ment questionnaires? 

What is the relation of seores on the psycho neurotie questionn: 
to other eriteria of adjustment } 

What is the relation between answers on a psychological quest 
naire and reading ability? 
The development of questionnaires to show adjustment in vari 
specifie situations. 
To what extent is it valuable to ask questions on childhood a 
vouth in the psycho-neurotic inventory 
Ilow do questions on types of situation compare with questions 
types of responses in the psycho-neurotie inventory 
To what extent is it desirable to include degrees of four or five ste} 
in the answers to questions in the psycho-neurotie inventory ? 
What changes in the psycho-neurotie inventory ean be produced by 


changing the examination or the school situation? 














ete.) influence the results of a psycho-neurotic inventory 
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lo what extent does the total situation,—examiner, preliminary 
] 
i 


lirections, oceasion (Freshman week, following an intelligence test, 


) 





ATTITUDE QUESTIONNAIRES 


Experimental studies of the influence of various educational pro 


ceedures,—the movies, assembly programs, lectures, posters, class 


’ 
( 


liseussions, ete., on attitude. 
Experimental studies of the relationship of various social factors 
nd influences to changes in attitudes. 


4} 


Correlation studies of the relationship of various factors and influ- 


es to attitude. 


What are the relations between attitude held and other measures 

personality,—intelligence, information, personality and behavior 

ratings, interest adjustment, emotionality, ete.? 

What is the relationship between certainty of opinion and extreme 
ness of attitude? 

What is the distribution of attitude within a group? 

lo what degree does an attitude scale (Thurstone method) retain 
ts identity when tried out on groups possessing various extreme 

attitudes ? 

What are the criteria for inclusion of statements in attitude seale 
Thurstone method) ? 

What is the reliability of Thurstone’s method of attitude measure 
ment? 

What is the consistency of conservativeness and radiecalness over a 
variety of issues? 

What is the relation between questionnaires on ‘‘How I Feel’’ and 
those on ‘‘ How I Think’’? 

Construction of attitudes questionnaires on a variety of issues, 
he Ith. the family, polities, edueation, religion, sex, ete 


lo what extent do attitude questionnaires agree with actual be 


INTEREST QUESTIONNAIRES 


What is the relation of adjustment to interest ? 


What are the physiological correlates of interest 


Can involuntary movement be used as an interest measure ? 


Experiments with various types of directions and forms of responst 


in interest questionnaires. 

















182 


90. 


91 


99 


100 


101 
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103 


104 


105 
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108 





JOURNAL OF EDUCATIONAL RESEARCH [ Vol. 24, N 


What factors are associated with interest? 

Experimental studies of the relationship of various social and edu- 
cational factors to changes in interest. 

What sex differences in interest are found? 

What age differences in interests are found? 

Interest analysis (Freyd-Strong-Cowdery technique) for women’s 
occupations. 

What is the relation of interest to ability? 

What is the permanency of interests,—interests in school studies 
in vocational choices, in vocational preferences, in play, etc. ? 
Experimental studies of the relationship of various social factors 


and influences to changes in interest. 


TESTS OF CONDUCT KNOWLEDGE AND ADJUSTMENT 
What is relation of moral standards to such things as the fr 
quency of the act, the seriousness of the act, motive, person affected 
by act, degree of personal sacrifice, ete.? 
What is the relation of moral knowledge and group conduct? 
What is the difference between the answer with personal referer 
and the abstract answer in tests of conduct knowledge, opiniot 
attitude, ete.? 
What is the relation of ability to foresee consequences to possessiot 
of general principles of conduct in specifie situations? 
What is the relation of conduct choices to ability to foresee cons: 
quences in specific situations? 
What is the relation of conduct choices to possession of genera! 
principles of conduct in specifie situations? 
What is the relation of Biblical knowledge to conduct? 
What is the relation of conduct to knowledge, opinion, judgment 
and attitude, determined experimentally by testing and coefficients 
of correlation? 
Development of tests of opinion and judgment of conduct issues 
specific situations: home, school, friends, work, sports, citizenshiy 


ete 


PERFORMANCE TESTS 
To what extent does it invalidate the results in a performance test 
of conduct to inform the pupil of what is being tested? 
To what extent does a small change in the situation affect tl 





results of a performance test of conduct? 
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Which is of more influence in determining a conduct response,—the 
person in the situation, the setting, the materials, or the motiv: 
To what extent does conduct transfer from one situation to another, 
determined experimentally ? 
How do various techniques for measuring honesty compare in re- ) 
liability, objectivity, ease of administration, ete. ? 
What is the relation between fact scores vs. graded scores in the 
measurement of honesty? 
What is the correlation of persistence with other measures of con- 
duet and personality ? 
What is the correlation of suggestibility (with intelligence par- 
tialled out) with other measures of conduct and personality ? 

THE FREE ASSOCIATION METHOD 
De velopment of the use of free association method in detecting 


eases of cheating or stealing in school. 





What is correlation between free associations of siblings? 
What is the optimum number of words in a free association list ? 
What factors should determine the selection of words in a free 
association list? 

What factors should determine the order of words in free associa- 
tion list? 

How can reaction time in free association be determined in groups? 
What differences are there in free association when words are pre- 
sented orally and visually? 

What accuracy is needed in recording reaction time in free asso- 
ciation ? 

What is the significance of observable behavior in free association? 
What methods are desirable in recording free association ? 

What value is there in having an individual give train of associa- 
tions which lead up to the response in free association? 

What is the reliability of various classifications of response in free 
association ? 

What is the correlation of response to other factors in free asso- 
ciation ? 

What is the relation of free association responses or reaction time 
to pupil-complexes,—brother, sister, parents, teacher, school, boys 
ind girls, sperts, studies, ete.? 

What is the relation of free association response or reaction time 


+ 


o intelligence? 











1S4 
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What is the relation of free association response or reaction t I 


; 
to age 


What is the relation of free association response or reaction ti! 


) 


to school achievement (or failure) 


What is relation of free association response or reaction tim 
reputation for behavior by associates? 


r reaction tim 


What is relation of free association response 
scores on the adjustment questionnaire? 
What is the value of free association as a measure of personal 


on : 


What is the validity of complex indicators in free association ? 

What is the correlation of reaction time to other measures 
emotion? 

Deve lopme nt of technique of free association in detection of fu 
Development of technique of free association in detection of fi 
What is the relation of free association response or reaction 1 
and measures of introversion-extroversion ? 

What value has the story and story reproduction method in 


detection of guilt and in the unearthing of complexes? 


PHYSIOLOGICAL MEASURES OF THE EMOTIONS 


How is the chemical composition of saliva, urine, and blood relate 


. » 
to personality? 


Standardization of the use of physiological measures of the emotion: 


in diagnosing de a ption. 


Wi il is the relation Oo! various physiological measures ot emotions 


to free-association reaction time? 
What is the relation of various physiological measures of the en 


ms to one another 


How do physiological measures of emotion change during 01 


What is the relation of physiological measures of the emotions 
cheating on examinations? 

What factors are related to the psycho galvanic reflex? 

What is the reliability of the psycho-galvanie reflex? 

What factors influence the reliability of the psycho-galvanie refl 
What factors are related to changes in breathing? 

What is the reliability of measures of breathing? 

What factors influence the reliability of measures of breathing? 


What factors are related to changes in pulse rate and volume? 














i4 
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What is the reliability of measures of pulse rate and volume? 
What factors influence the reliability of measures of pulse rate and 
volume? 

What factors are related to changes in blood pressure 
What is the reliability of measures of blood-pressure ? 

What factors influence the reliability of measures of blood-pressur 
What are the physiological measures of emotions of those exhibiting 
ehavior characteristics indicative of maladjustment ! 

What are the characteristics of physiological measures of emotions 


school examination situations? 


INTERVIEWING 

What methods of recording interviews are most satisfactory and 

forming? 
[he regression effect in interviews. To what extent is it real and 
inder what conditions? 
What factors are related to the accuracy of testimony) 
How does the first interview compare with the second interview 
n re liability, « mpleteness, type of material disclosed, ete 
What does attention to the non-verbal factors contribute to an 
nterview ? 
How does using prepared questions in the interview compare with 


» the situation determine the 


illowing the circumstances peculiar t 
juestions ? 
What are the relative values of techniques for meeting resistanes 
nd lessening tension in the interview? 
What is the effect of contradicting or opposing the subject in th 


) 


terview as compared with agreeing with him? 
What are the relative values of various devices In securing rapport 
n the interview? 
How do the conditions of the interview,—third person present, 
friendships, ete., affect it? 
What value has the preview in an interview? 
What differences are noted between voluntary and involuntary in- 
terviews, reliability, consist¢ ney, complet ness, ete.? 
l'o what extent is it possible to improve the quality of interviewing 
through training and practice ? 


What are the qualifications of a good interviewer ? 


In an interview, is it desirable to use questions first and give the 
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subject free expression later or to use the procedures in reverse 
order , 

In an interview, is it better to start with a lite history of the ind 
vidual or with a discussion of the present irritating circumstances 


Does the anonymous questionnaire have any advantages over the 


questionnaire to which the name has been signed ? 

Which is the better adapted for obtaining disclosures as to feelings 
moods, wishes, ete..—the interview or the questionnaire? 

Which gives the more information and more accurate informa 
tion concerning childhood and youth,—the interview or the ques 
tionnaire 

Which will contain the greater number and more accurate persot 
admissions and revelations,—the interview or the questionnair 
To what extent will two persons who listen to an interview ma! 
the same interpretations and draw the-same conclusions? 

To what extent are questions better understood during an inter 
view than in questionnaires? 

To what extent will two interviewers follow up the same deads d 
ing an interview? 

Comparison of the interview with the questionnaire as to reliability 


and validity. 


PSYCHOANALYSIS 
Techniques for following up a free association. 
Can defense mechanisms be used in adjustment questionnaires 
i.e., can various common defense mechanisms be listed to be recog 
nized by a person as representing his own or others’ reactions? 
Can escape mechanisms be used in adjustment questionnaire; 1. 
can various common escape mechanisms be listed to be recognized | 
a person as representing his own or others’ reactions? 
Can rationalization be used in adjustment questionnaires; 1.e., ca! 
various common rationalizations be listed to be recognized by 
person as representing his own or others’ reactions? 
The use of rationalization in attitudes questionnaires. 
Can transference be used in adjustment questionnaires; 1.¢., ¢ 
various common forms of transference be listed to be recognized | 


a person as representing his own or others reactions? 


A questionnaire study of regression ; i.e., can various common forms 


of regression be listed to be recognized by a person as representi! 


his own or others reactions? 


r 
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Can identification be used in adjustment questionnaires; i.e., can 
various common forms of identification be listed to be recognized 
by a person as representing his own or others’ reactions? 

Can projection be used in adjustment questionnaires; i.e., can 
various common projections be listed to be recognized by a person 
as representing his own or others’ reactions? 

Can compensation be used in adjustment questionnaires; i.e., can 
various common compensations be listed to be recognized by a per- 


son as representing his own or other’s reactions? 


EXTERNAL SIGNS OF CONDUCT 
What is the relation between the claims of graphologists and other 
measures of personality or conduct? 
What is the relation between various hand and facial measure- 
ments and other measures of personality and conduct? 
What is the relation between physique and the introversion-extro- 
version difference ? 
What is the relation between freedom from bodily defects and 
personal vigor and adjustment? 
How is physique related to adjustment? 
What is the relation of physique to vocational choice and to voea 
tional suecess ? 


What is the relation of physique to leadership? 


MEASUREMENT OF THE ENVIRON MEN’ 

The development of a questionnaire designed to measure the social 
and character development possibilities of a school. 

The developme nt of a questionnaire designed to measure the social 
and character development possibilities of the home. 

The development of a measure of the community environment using 
a technique similar to that used in the Sims Seale. 

The development of a measure of the school environment using a 


technique similar to that used in the Sims Seale 


intial 











THE ARITHMETICAL BACKGROUNDS OF YOUNG CHILDREN 


CLIFFORD Woopy 
University of Michigan 
PURPOSE OF THE INVESTIGATION 
THE purpose of this report is to present some results obtained fron 
an investigation designed to ascertain facts concerning the amount of 
arithmetical knowledge and skill possessed by children in the primary 
grades at the time at which formal instruction in arithmetic is introduced 
For this investigation the time at which formal instruction is introduced 
was specified as the time at which a definite period in the teaching 
schedule is set aside for presenting facts and concepts according to a 
definitely schematized plan. “The emphasis on systematized instructior 
in a period specifically set aside for such instruction differentiates 
from incidental instruction which is given in response to the numbe1 
needs often encountered in primary classrooms. Furthermore, formal 
instruction was described as planned and organized, but it was pointed 


out that it did not necessarily imply the use of a textbook. 


TABLE I 


OUTLINE OF CONTENT OF INVENTORY TEST . 
Number of 
Type of Exercise Exercises 
Part I 
Rote counting without objects 5 
’ "» 


Counting by enumeration. 

Recognition of number as a croup 
Domino arrangement . 4 
Dot arrangement 
Line arrangement... + 
Star arrangement 3 

teading of numbers 
Numbers on a calendar 
Numbers in a row. 
Numbers in columns 12 
Pages in a book 


Part II 

Size of numbers 

Numbers with concrete objects - ; 

Numbers in the abstract 14 
Telling time 

Reading time from face of clock 4 

Placing hand to designate time 4 
Fractions 

Recognition of fractions 3 

Size of fractions Sy 
United States Money 

Recognition of coins . 5 

Value of coins ba 12 
Linear measure : 4 
Liquid measure 4 
Solving simple verbal problems ‘ péea . 18 

Part III 

Exercises in addition 89 
Exercises in subtraction ‘i oanene TT eS 

Total ° Soetevene peeesece TTTTT 
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THE INVENTORY TEST 
rhe data presented in this report were obtained through the admin- 
stration of an inventory test consisting of 204 different arithmetical 
situations to which the child was asked to make response. Table I indi- 
tes something of the nature and number of the different types of exer- 
es involved. In selecting the items for the test consideration was given 
to the following points: (1) the test should include only those types 
situations which exist in the social environment of the child; (2) the 
test should inelude a great variety of situations so as to provide as 
plete an inventory as possible and to determine the children’s 
miliarity with the various aspects of the number concept as outlined 
Thorndike ;* (3) the test should be simple enough for use with chil- 
en in the Kindergarten and in Grade 1 and at the same time difficult 
: ough for use with children in Grades 2 and 3. The various test items 
_ re selected only after the most careful scrutiny of the literature deal- 
g with the teaching of primary arithmetic and of the published list of 

bjectives enumerated for the primary grades. 


THE ADMINISTRATION OF THE TEST 

In general, the tests upon which this report is based were administered 
May, 1929 by primary teachers in thirty-nine different school systems 
lely seattered throughout the United States. In one or two cities the 
sts were administered near the beginning of the first semester of the 
1929-30 school year. In these cities the children interviewed were in the 
grade in which formal instruction was to be introduced. In ten of the 
rger cities over one hundred pupils were interviewed, but in most cities 
the number was considerably less than one hundred. In all but one city, 
no children except those in the grade just previous to that in which formal 
instruction in arithmetic was begun were interviewed. As a rule, each 
primary teacher interviewed only six pupils selected at random from 
those in her room. In one city, however, the following variations in 
rocedure existed: trained specialists instead of the regular primary 
teachers interviewed the pupils; all pupils in Grade 1A in all class 
oms instead of just six pupils in each class were interviewed ; a number 
pupils in all of the primary grades were interviewed in addition to 
those in the grades just previous to the one in which formal instruction 
introduced. These variations were introduced for the sake of securing 


f 


* Thorndike, Edward L. Psychology Arithmetic. 
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more complete observations of the pupils’ responses than untrained 
observers were apt to get and for securing comparative data to aid in 
interpreting the facts obtained in the grades just previous to those in 
which formal instruction is introduced. 

It should be emphasized that the test was merely an interview test 
and in no sense standardized. For purposes of administration, it was 
divided into three parts: Exercises I to IV constituting Part I; Exer-. 
cises V to IX, Part Il; and Exercises X and XI, Part III. The test 
was administered individually and had no time limit, although thos 
responsible for the interviews indicated that on the average each child 
took approximately twenty minutes for each part of the test, depending 
somewhat upon the rate at which the child responded to the different 
exercises and the amount of time required for the person administering 
the test to record observations on the pupil’s behavior in making t 
responses. } In the interview, all instructions were given orally.  T! 
child was given only one opportunity to respond to each item but he was 
allowed all of the time he desired in making his response. If it w 
evident, however, that he was unable to make a ready response he \ 
confronted with the next exercise. During the interval of making 
response the person conducting the interview recorded whether he mac 
the proper response and made notes on any outstanding characteristics 
of his behavior. 

RESULTS 

Two different types of tabulations will be presented: tabulations 
showing the distributions of scores on the tests as a whole and tabulations 
showing responses to given sections of the test. After presentation of 
these tabulations consideration will be given to some observations mac 
by those conducting the interviews. 

Responses of the children to the tests as a whole.—Table II exhibits 
the distribution of the number of correct responses made by the childret 
in the different grades. The same facts are presented in the form 
a percentile graph in Figure 1. / Before discussing the significance of th 
distribution of the scores, it should be pointed out that consideration of 
the number of pupils interviewed reveals that by far the greatest number 
of children were in Grade 1A, indicating that in a majority of school 
systems formal instruction in arithmetic is begun at the beginning o! 
Grade 2. , The next most common practice is to introduce such instruc 


tion at the beginning of the second semester of Grade 1. It is evident 
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from this tabulation and from the original interview blanks that in som 
schools formal instruction is begun during the first semester of Grade 1} 
in other systems it is postponed until the beginning of Grade 3. Suc} 
observations are in keeping with other existing facts concerning th 


time for introducing such instruction. 
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F ] SCORES ATTAINED IN THE DIFFERENT GRADES 


Probably the most outstanding point portrayed by Table II and its 
graphie presentation is the wide range in the number of correct responses 
given by the children who responded correctly to a very small number 
of the items of the test and by those who responded toa surprisingly large 
number of the exercises. It is reasonable to expect some range in th 
achievements of the children in a given grade, but it is rather surprising 
to find that the ranges in the Kindergarten and Grade 1B are almost 
as large as in Grades 1A, 2B, and 2A. Some overlapping of the responses 
of the pupils in the various grades was to be expected, but the number of 
correct responses made by the children in the Kindergarten and Grad 
1B was not anticipated. Incidentally, it may be added that teacher aft 
teacher in one of the school systems commented to those administering 
the tests that it was useless to interview the children in the given grad 
because so many of the test items were beyond the abilities of thei 
children. 

Examination of the median scores indicates that the children in the 
Kindergarten responded correctly to approximately one-fourth of th 
exercises; the children in Grade 1A, to nearly one-half of them; and 
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\ildren in Grade 2A, to about three-fourths of them. These facts 
ill the more significant when it is recalled that the children under 
leration had received no formal instruction in the school. The 
ess between Grades 1B and 1A and between Grades 1A and 2A is 
er outstanding as indicated by the wide differences between their 
ective medians and the percentile curves showing the achievement of 
respective grades. There is not so much difference between the 
evement of the children in the Kindergarten and Grade 1B and be- 
tween that for the children in Grades 1A and 2B. This may be due to the 
eliability of the data for the children in these grades or to the fact 
the children in the B-sections of these grades, i.e., those entering 
respective grades at mid-year, make relatively lower scores than the 
children entering the grades at the beginning of the regular year. 
(he data indicate that the median number of correct responses for 
s tends to be higher than the median number of correct responses for 
girls. The difference in the number of correct responses, usually six 
eight exercises, is not statistically significant as indicated by the co- 
ents of the significance of the difference given at the bottom of the 
yet in all grades the number of correct responses is greater for the 
; than for the girls. In tabulations showing the percentages of boys 
| girls responding correctly to each group of exercises within the test, 
percentage for boys is again higher than that for girls in a large 
majority of the types of exercises. This fact would lead one to believe 
that this difference in the responses of the boys and girls may have more 
vnificance than the coefficients suggest. 
‘able III is similar to Table I1, but it contains only the responses 
le by six-year old children in the various grades. A six-year old 
was defined as one whose age was between five years, six months, 
six years, six months. The facts of this tabulation are shown in 
Figure 2. This tabulation and graphic presentation reveal about the 
same tendencies as presented in Table II and Figure 1, with the exception 
the difference between the number of correct responses by the boys 
d girls in the different grades are somewhat different when the factor 
ige is kept constant. The boys on the whole tend to make the greater 
nber of correct responses, but the differences are not as great as in the 
vious exhibits. 
Responses to the exercises involving counting—Table IV presents the 
extent to which the children in the Kindergarten to Grade 2A, inclusive, 
could count. Approximately one-fourth of the children in the Kinder- 
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Fic. 2. Scores ATTAINED BY BoysS AND GIRLS Srx YEARS OF AGI 
TABLE IV 
AGE OF CoRRECT RESPONSES GIVEN TO EAcH COUNTING EXERCISE BY THE 
CHILDREN IN THE PRIMARY GRADES 
(rrade 
Item Kinder 
garten 1B 1A 2B 2A 
ting to 100 by l's A 26 7) 66 76 94 
inting to 100 by 10's , 32 i6 69 76 93 
nting to 30 by 2's 7 14 34 28 68 
iting to 30 by 3's ; 2 9 11 16 
ng backward from 20 by 2’s 4 ; 12 12 5 
g¢ 20 circles and pointing order whi 
4 71 79 9 8 ) 
of children O4 f { 1897 RO 238 
en, almost two-fifths in Grade 1B, two-thirds in Grade 1A, three- 
ths in Grade 2B and over nine-tenths in Grade 2A eounted to 100 
l’s. About the same proportion of the children counted correctly 
100 by 10’s. Approximately three-fourths of the children in the 
\indergarten and Grade 1B counted the twenty cireles and pointed at 





in proper order as they counted. In Grades 1A, 2B, and 2A over 


tenths of the children responded correctly to this exercise. Some 
ren in each grade responded correctly to each of the other exercises, 


the percentage of correct responses while increasing from grade to 


le were much smaller than those for the enumerated exercises. 
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To the writer the data presented in this table reveals four outstand. 
ing facts: (1) the children have considerable knowledge of counting 
even though formal instruction in the subject has not begun; (2) the 
percentage of correct responses increases from grade to grade; (3) the 
exercises involving counting twenty cireles and counting them in order 
proved easier than rote counting to 100 by 1’s or 10’s; (4) the exercise 
involving rote counting to 100 by 10’s was easier than that involving 
counting to 100 by 1’s. 

Before passing to the next group of exercises it may be well to point 
out that on the set of six exercises and on each of the items in almost 
every grade there was a slight superiority in the percentage of correct 
responses in favor of the boys. 

Responses to exercises involving the telling of time.—The first four 
exercises involving time required merely the reading of the time as indi- 
cated on drawings of the face of various clocks; the last four exercises, 
the placing of the minute hand on the clocks to indicate designated times 
of day. The most significant facts portrayed in Table V are: (1) the 


TABLE V 


PERCENTAGE OF CORRECT RESPONSES TO EACH EXERCISE INVOLVING THE TELLING OF 
TIME MADE BY THE Boys AND GIRLS IN THE PRIMARY GRADES 


Grade 
Items Kindergarten 1B 1A 2B 2A 

tN fa N ——— ooo a —* = 

Boys Girls Boys Girls Boys Girls Boys Girls Boys Gir's 
1. Clock says 9 o’clock........... 41 40 82 29 53 49 55 50 72 78 
2. Clock says 1 o'’clock........... 52 44 87 34 56 51 52 45 74 70 
8. Clock says 12 o'’clock.......... 41 38 49 44 69 67 64 63 91 96 
4. Clock says 3:30 o’clock........ 7 4 8 5 19 12 17 13 44 41 
5. Place hand at 7 o’clock......... 22 19 26 21 47 42 36 42 75 78 
6. Place hand at 5 o’clock........ 24 21 22 19 44 39 31 42 73 75 
7. Place hand at 10 o’clock....... 20 19 24 19 44 41 33 89 74 80 
8. Place hand at 11:45 o’clock..... 7 2 11 4 14 10 19 8 38 36 
Oe Es Kee weciddes anne 46 48 315 289 929 968 42 88 117 121 
ee NON. 4 ks ees wdencedaccvne 27 23 26 22 43 39 38 38 68 69 


mean percentage of correct responses on all of the exercises for the chil- 
dren in the Kindergarten and Grade 1B was approximately 25 percent; 
for the children in Grades 1A and 2B, slightly over 39 percent; for 
Grade 2A, 69 percent; (2) the exercises involving the reading of the time 
were considerably easier than those in which the placing of the minute 
hand to indicate a given time was required; (3) on most of the exercises, 
especially the more difficult ones, the boys had a higher percentage of 
correct responses than the girls. 
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Responses to exercises involving fractions—From Table VI there is 

lence that children in the primary grades have considerable famili- 

ty with the fractions: one-half, one-third, and one-fourth. Approxi- 
mately two-thirds of the children in the Kindergarten and Grade 1B, 
three-fourths in Grades 1A and 2B, and nine-tenths in Grade 2A selected 
from the set of pictures of apples cut into various fractional parts, the 
me which showed the apple cut into halves. Almost half of the children 
n the Kindergarten and in Grade 1A, and slightly over two-thirds of the 
children in the other grades under consideration were able to select the 
pples eut into fourths and thirds. The percentages of children re- 


TABLE VI 


PERCENTAGE OF CORRECT RESPONSES TO EACH EXERCISE INVOLVING FRACTIONS MADE 
BY THE Boys AND GIRLS IN THE PRIMARY GRADES 
Grade 
Items Kindergarten 1B 1A 2B 2A 
— — — ‘ 





Boys Girls Boys Girls Boys Girls Boys Girls Boys Girls 


POINT TO APPLE 
Cut into halves... . tiuvewe “Te 65 68 65 77 77 86 76 89 86 
Cut into fourths......... es 41 48 52 52 67 68 7 71 74 74 
Cat Mie CNUs co cece scnseace 37 42 45 46 67 63 60 63 75 78 
YOU CAN CUT AN APPLE INTO 
How many halves......... . 46 45 42 44 51 55 29 50 41 
How many fourths............ 80 17 30 27 35 36 52 29 48 44 
How many thirds......... -- 26 17 24 20 33 85 33 26 50 44 
WHICH IS LARGER! 
Half or whole apple........... 80 88 85 85 94 98 100 100 97 98 
Fourth or half apple....... i oo 42 43 42 49 46 69 47 71 59 
Half or third of apple......... 17 19 35 29 46 43 52 61 74 69 
Fourth or third of apple....... 41 35 35 36 33 33 29 39 25 28 
Half, third, or fourth of apple.. 15 10 20 18 35 B34 52 32 62 68 
a eee ere 46 48 315 279 929 968 42 388 117 12! 
OM PONE C64. sae cdckackseokes 40 89 44 41 53 58 60 52 65 62 


sponding correctly to the questions involving knowledge of the number 
of halves, thirds, or fourths into which an apple can be cut was con- 
siderably less than the percentage responding correctly to the exercises 
nvolving the designation of apples cut into enumerated fractional parts. 
The responses to exercises involving the relative size of the fractions 
ndieate that a very large proportion of the children knew that a whole 
apple is larger than half an apple; approximately half of them knew 
that half of an apple is larger than a fourth of an apple. A considerably 
smaller proportion of the children responded correctly to the exercises 
involving half and third, fourth and third, and half, third, and fourth, 
but the percentage making correct responses indicates some understand- 
ng of the meaning of size of these fractions. The responses to the last 
five of the exercises involving the size of fractions are somewhat subject 
to error arising from the form of the test exercises, but those responsible 
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TABLE VII 


PERCENTAGE OF CorrRECT RESPONSES TO THE EXERCISES IN ADDITION MADE BY TH! 
CHILDREN IN THE PRIMARY GRADES 





Grade 
Exercise 10 Kindergarten 1B 1A 2B 2A 
= A - - A —_—, — ——, — aS! —— ‘ — 
Boys Girls Boys Girls Boys Girls Boys Girls Boys Gir 
2+1 43 38 57 46 81 76 88 87 92 as 
0+2 30 31 40 30 61 51 74 63 80 84 
6+2 26 13 32 22 61 53 74 63 87 R7 
7+ 1 33 19 42 30 68 63 31 68 5 
2+2 41 27 47 37 74 70 90 74 92 9 
7 l 33 17 41 29 69 62 83 68 91 95 
6 ; 15 13 28 20 57 49 69 58 85 R4 
5 4 15 8 22 14 53 42 71 58 R4 83 
+7 i 4 12 6 34 26 45 42 63 64 
6+4 4 6 21 10 47 39 50 50 76 72 
3+9 7 8 13 6 36 28 33 45 66 69 
9+ 1 13 10 80 20 58 §2 67 61 88 +] 
+8 6 4 13 3 20 23 36 37 65 
13 8 80 19 58 51 60 63 86 9 
Q 8 2 7 3 18 14 14 18 4 
7+6 4 2 10 3 28 20 36 32 5 
2 ; 3 Q 8 16 Rx 82 38 42 72 67 
4 l 2 11 4 17 8 43 35 50 42 75 7 
2+3 l 11 4 14 8 ) 31 40 45 76 
4+ 2 11 2 16 7 38 30 45 37 71 64 
1 3 4 6 16 6 40 50 45 74 7 
2+4+9 2 7 3 8 33 29 57 47 
4 Qa 5 2 17 12 19 3 50 7 
2 +8 5 2 18 13 6 21 57 44 
12+3 11 6 12 6 33 26 36 42 68 67 
ore - 9 4 26 2 17 37 65 60 
21 7 2 3 1 11 12 11 39 
l 2 4 4 11 4 29 2 26 34 71 64 
1248 4 5 1 16 13 17 24 44 4 
16+5 4 2 7 2 20 15 24 18 58 51 
29+4 2 4 6 1 16 14 14 29 50 4 
18+9 3 0 9 . 5 16 36 33 
22 13 l 2 0 3 4 5 23 24 
41 l 2 2 3 4 8 18 . 
4 12 1 3 3 5 19 : r] 
7+ 84479 0 6 
24 453 1 3 2 17 
7¢ 412 2 5 8 5 
987 + 456 + 321 237 3 2 
Number of pupils 46 48 315 289 929 968 42 38 117 121 } 
Mean percent 9 7 15 9 32 27 37 36 59 57 ' 

















a Cotes . 
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the interviews were instructed to make a record of the pupils who 

seemed to be guessing and who had no understanding of the responses 
ade. In general, the facts in this table suggest that children in the 
primary grades have some knowledge and understanding of such frac- 
tions as halves, thirds, and fourths, and that such concepts are within 
the comprehension of such children. Incidentally, in almost all grades, 

s interesting to note that on this set of exercises and on most of the 

dividual items the boys gave a slightly higher percentage of correct 
responses than the girls. 

Responses of the children to the exercises involving addition.—Table 
VII indicates a great range in the knowledge of addition possessed by 
children in the primary grades before formal instruction was introduced. 
(‘onsideration of the mean percentages on all of the items or on any one 

’ them shows that the amount of knowledge increased from grade to 
grade. The children in the kindergarten manifested considerable knowl- 
edge of the easier combinations, some knowledge of the harder ones, and a 
little knowledge of the exercises involving adding three one-place num- 
bers and those involving a two-place number and a single place number. 
In each of the suecessive grades an increasingly greater percentage of 
he pupils gave the correct responses to these types of exercises and to 
those types representing more difficult combinations and more compli- 
eated processes. The children in Grades 1A, 2B, and 2A ready for the 
ntroduction of the formal study of arithmetic in the school systems under 
consideration at the beginning of the next school year, possess, if their 
scores mean anything, a surprising amount of knowledge of the subject 
matter to which they will be exposed during their first year of system- 
tized instruction. Other tabulations not presented in this discussion but 
exhibiting the distribution of responses made by individual children on 
the sets of exercises, reveal that some children in each of the grades 

ve given almost one hundred percent responses to all the types of 
exereises which will be taught during the first vear of formal instruction. 
he variation in the pereentages of correct responses to each of the 
items is enlightening, but not quite so much as is the variation made in 
the responses by individual pupils. 

Space will not permit a more detailed analysis of the facts given in 
Table VII, but attention should again be called to the fact that the boys 

each of the grades under consideration made a greater percentage of 


rreet responses on the test as a whole and on most of the items in the 


+ 
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OBSERVATIONS MADE DURING RESPONSES BY THE CHILDREN 


The facts presented in the previous sections represent the final re 
sponses made by the children, but it should be pointed out that these 
~ responses should not be taken at one hundred percent face value. In 
many cases the record finally given a child was indicative of his real 
achievement, but in other cases it was a poor indication. Some children 
responded accurately with rapidity and assurance; others responded 
slowly with frequent self-corrections and by means of ‘‘crutches.’’ 

A few illustrations will show the necessity of caution in interpreting 
the results obtained. In rote counting, some children after completing 
the exercise offered to count most satisfactorily to 100 by 5’s, to count 
above 100, or to count backwards from thirty by 1’s; others, while 
finally stumbling through with no more aid than general encouragement, 
counted rapidly to 20 or 30 or even 40 and then paused, repeated the 
count of 40 two or three times, started again counting rhythmically for 
a time, and then repeated the faltering process. Some children responded 
correctly in rote counting to 100 by 10’s and to 30 by 2’s or 3’s, but at 
the same time repeated the intervening numbers in an audible whisper. 
In fractions, some children responded correctly to the questions con- 
cerning the size of halves and fourths, but had to look at the pictures of 
the apples cut into fractional parts before answering; one child stated 
that a whole apple was larger than a half apple unless the apple was 
a very small one; still another stated that an apple could be cut into 
halves, but added that if the apple were very large it could be cut into 
three halves. In addition, many children gave the correct response to 
the different exercises but determined the response through counting. 
Some counted aloud, others silently; some counted their fingers, objects 
in the room, cherries in the pattern of dress, or by the making of marks on 
paper. A few did double counting, e.g., in adding 8 and 5 they would 
count by rote to 8 and then say 8 and 1 more are 9, 8 and 2 more are 10, 
ete., until they had counted off 8 and 5. Other illustrations might be 
cited, but enough have been given to suggest that the interpretation of 
the final responses made to exercises like those constituting this interview 
blank must be conditioned not only by themselves but also by the method 
employed in arriving at the responses. 


CONCLUSIONS 


From this study five outstanding conclusions are warranted: 1. that 
children possess much ability in the elementary processes of arithmetic 
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ven before the time of beginning formal instruction in the subject; 
that the knowledge possessed by children is not limited to counting 
d adding simple combinations, but includes elementary knowledge of 
fractions, United States money, units of various types of measurement— 
d the understanding of the processes demanded in simple verbal prob- 
ms; 3. that extended inventory tests designed not only for throwing 
ght on the goals of achievement, but also upon the methods employed in 
ttaining the goals should be given before the beginning of formal in- 
truction if instruction is to be adapted to the needs of the individual 
child; 4. that the method of attaining a solution must be taken into con- 
sideration in interpreting the significance of a given attainment; and 


sf 


). that a small but persistent tendency exists for boys to make a slightly 
greater percentage of correct responses to tests as a whole and to indi- 
lual items of the test than girls. 














A METHOD FOR MEASURING RETENTION IN READING 


ALVIN C, EuRIcH 
University of Minnesota 

READING has no particular merit in broadening the experiences of an 
individual unless what is read is retained. One may comprehend whil 
reading and yet, immediately following the process, not remember all the 
ideas that were symbolized by the printed words. This phenomenon prac- 
tically forces one to believe that comprehension and retention are two 
separate functions of the reading process. The literature is confusing 
at this point, since a number of studies are reported in which ‘‘com- 
prehension’’ is supposedly measured by the amount of a passage an indi- 
vidual ean reproduce immediately after he has read it. Beeause of this 
unwarranted and unrestricted use of the term ‘‘comprehension’’ there is 
need for an attempt to isolate certain factors that have been obscured by 
such loose terminology. The method involved in the Minnesota Reading 
Examination Xi XIII’ is one effort in this direction, since the test is con- 
cerned with the measurement of the information which a student retains 
from the reading of a given passage. 

The Construction of the Test.—Reading passages that were of a fai 
degree of difficulty for college students and that contained a _ propor- 
tionately large number of facts or items of information were sought 
After a perusal of a number of books which had been written for the 
college population, it was decided to make the selection from Newma 
and others, The Nature of the World and of Man. To provide the reading 
material for Form A of the test, pages 191 to 197 were printed in a 
separate booklet. These pages are concerned with a diseussion of Th 
Evolution of Life and are so labeled on the printed booklet. For Form B 
a discussion was reprinted from The Eugenic Program as it appears 01 
pages 434 to 439 of the same book.’ 

The next step towards the completion of these two forms was th 
framing of an objective examination on the information contained 1 
each of the booklets. The type that seemed most applicable in this i 
stance was the multiple choice. This precluded the measurement of 1 
tention by reeall and practically assured its measurement by recognitio. 
which probably indicates maximum retention rather than minimum 


‘For more complete data regarding this test see: Eurich, A. C. Reading Abw 
ties of College Students. Minneapolis: University of Minnesota Press, 1951. 
? Permission to reprint these pages was obtained from the University of Chieag 


Press. 
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When finally formulated, the two examinations consisted of fifty units 
each which covered thoroughly the text of the reading passages. These 
examinations were printed in separate folders to permit their use under 
varying conditions. 

Vethods of Scoring.—For scoring purposes, each of the fifty units 
in the test was defined as a task and one point was given for each. For 
some tasks, successful completion required that two or more phrases be 
inderlined, whereas in other tasks one phrase was sufficient. Because of 
this fact the method of scoring that was adopted may be open to question. 
In order to note its agreement with other methods of scoring, one set of 
papers was scored in three ways. First, the number of correct units 
was determined. Seeond, one point was given for every item correctly 
inderlined regardless of the units. In other words, if one unit contained 
two items it was given two points. Third, one point was assigned for each 
tem correctly underlined and one point was subtracted for each item 
which was wrong. As a measure of the agreement between the first 
method of scoring and the other two, the coefficients of correlation were 
obtained. That found between the first and second methods is .89 + .02. 
Between the first and third methods it is also .89 + .02. These values 
suggest fairly close agreement; in fact, the coefficients are higher than 
the reliability of the test itself. Sinee the relation is as close as indi- 
cated, the first method was adopted for future scoring as it took some- 
what less time and was simpler to persons scoring the tests. 

Reliability —With this scheme for scoring, the reliability values were 
first sought in the correlations between the two forms. Since the tests 
were given before the students read the passages and again immediately 
after they had read them, the correlations as presented in Table I have 
due regard for these two periods of testing. The coefficient of correlation 

TABLE I 
EXAMINATIONS X1 XITI—RELATION BETWEEN THE EXAMINATIONS 


ON THE EVOLUTION OF LIFE (A) AND THE 
EUGENIC PROGRAM (B) 


Time of Testing r P.E 
Before Reading 34 + .05 
After Reading 53 + .04 
between Forms A and B before reading is .34 = .05. After reading this 


becomes 53 : 04. 
One may be in error in interpreting these coefficients strictly as 


measures of reliability, inasmuch as the nature of the reading material 








204 JOURNAL OF EDUCATIONAL RESEARCH [Vol. 24, No.3 


varies from one form to the next. In Form A, or ‘‘The Evolution of 
Life,’’ the reading matter is rather general, whereas in Form B, or ‘‘ The 
Eugenie Program,’’ it is very specific and precise with many figures that 
add to its exactness. Because of this fact, the two forms may actually be 
measuring different factors in the reading process. Before such a con- 
clusion can be drawn, however, further experimentation is necessary with 
this type of test. 

Other reliability coefficients were found by securing the correlations 
between the two halves of the tests and projecting these values with the 
Spearman-Brown formula. As calculated in this manner, they appear 
in Table II for the test given ‘‘before reading,’’ ‘‘after reading,’’ and 
**one week later.’’ Such an arrangement was possible, since for one group 


TABLE ITI 
RELIABILITY OF EXAMINATION Xr XIII 


Time of Testing A B 

Before Reading .79 + .03 29 + .10 
After Reading 69 + .05 .63 + .05 
One Week Later 84 + .03 74 + .05 


of college juniors the test was given at the three periods indicated. These 
correlations are somewhat higher than those reported between the two 
forms of the test. They reveal further evidence that there is a difference 
between the two forms. For Form A the reliability coefficient ‘‘ before 
reading’’ is .79 = .03, whereas on the same period of testing for Form B 
the coefficient is only .29 = .10, which indicates that scores on the latter 
form are largely due to chance. Those on the first form depend upon 
the information concerning The Evolution of Life which was previously 
acquired. The reliability coefficients for the ‘‘after reading’’ scores are 
approximately the same magnitude for both forms of the test (.69 for 
Form A and .63 for Form B). The scores ‘‘one week later’’ are even 
more reliable (Form A, .84; Form B, .74). Obviously the test is least 
reliable before reading, more reliable after reading, and most reliable 
one week after reading the passage. This seems to be particularly true 
of the test that covers the specific material. In order to secure a better 
appreciation of these reliability coefficients there is need for further work 
with retention for specifie and general material. 

Validity.—As with most other tests, the validity of the Minnesota 
Reading Examination Xi XIII must rest almost exclusively upon its 
inherent nature. In all probability it approaches an actual study situa- 
tion more closely than any tests which are now available. Before reading 
the passage the student secures an idea of its content through the ques- 
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tions in the test. During the reading process, he has the opportunity 
collect facets with reference to that idea with the definite intention of 
iking an examination upon those facts as soon as he has completed his 
ling. 
Relation to Other Variables.—The extent to which scores on this test 
predictive of achievement in a limited number of college courses may 
observed from the coefficients of correlation in Table III. In the 


TABLE III 
THE RELATION OF EXAMINATION Xr XIII TO ScHOLARSHI! 


Course Form A Form B 
Educational Psychology 42 + .06 34 + .06 
How to Study 44 + .06 33 07 
Honor Point Ratio for all Courses 35 5 


ilation of these coefficients the percent of possible gain that was 

de on the ‘‘after reading’’ test over the ‘‘before reading’’ test was 

| as the score for Examination Xi XIII. To establish the possible 

the total number of units in the test was used as the upper limit. 

[his was 50 points. An illustration of the application of this method 

aid in clarifying any obseure points in this brief description. If a 

student secured a score of 20 ‘‘before reading,’’ his possible gain is 30 

ints. If his seore is 35 ‘‘after reading,’’ he has gained one-half of 
s possible gain, or fifty percent. 

Certain defects of this method are at once apparent, since it is not 
nown that anyone can secure the total number of points in the test 
ter he has read the passage. The truth of this may make the statement 
the possible gain a fallacious one. It does, however, afford an arbitrary 
int of referenee that is constant for all. 

Figures which are expressive of the degree of relationship between 

s test and intelligence, vocabulary, and reading comprehension appear 

Table IV. If the Minnesota College Ability Test is used as a measure 


TABLE IV 


THE RELATION OF EXAMINATION X1 XIII TO OTHER VARIABLES 


Variable Form A Form B 
College Ability Test 41 + .07 40 07 
Minn. Reading Examination, Part I 21 + .06 14 + .06 
Minn. Reading Examination, Part II 37 + .05 26 + .06 
Minn. Speed of Reading Test, Form A 45 + .04 


ntelligence, the coefficients of correlation of .41 for Form A and .40 for 
form B denote the relationship between intelligence and the percent of 
ssible gain on Examination Xi XIII. Sinee Part I of the Minnesota 
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Reading Examination is a vocabulary test, the coefficients .21 and .14 are 
indicative of the relationship between Examination Xi XIII and vocabu- 
lary. For Part II, or reading comprehension, the coefficients are some- 
what larger, while that secured for the Minnesota Speed of Reading Test 
is the largest of all. None of these coefficients are high. Corrected for 
attenuation they would all be considerably higher. Whether or not they 
are indicative of the true relationship between these variables remains for 
further demonstration. 

Application of the Test —Aside from the application of this test under 
the experimental conditions for which the instrument was designed, it 
was used with several groups under varied circumstances in order to com- 
pare the relative gains. With one group of forty students, all of whom 
were college juniors, the initial test was given under conditions which 
gave each individual all the time he required to respond to the fifty units. 
The reading pamphlet was then given with directions to read it once. 
Immediately upon the completion of this reading the students turned in 
their booklets and the reading time was recorded. As soon as all booklets 
were gathered, the second test was administered under precisely the same 
directions as the initial test. One week following this reading the same 
test was given again for the purpose of determining the loss during the 
interim. The facts as derived are arranged in Table V. The means and 


TABLE V 


AMOUNT OF RETENTION AS MEASURED BY EXAMINATION X1 XIII 
WITH UNLIMITED TIME 


Form A Form B 


The Evolution of Life The Eugenie Program 

M P.E. 8.D. M. .P.E S.D. 

Before Reading 16.33 + .45 4.2 16.58 + .45 4.2 

After Reading 28.74 + .45 4.2 35.00 + .50 4.6 
Gain 12.41 + .64 18.42 + .68 

One Week Later 26.44 + 52 4.8 32.05 + .52 4.8 
Loss 2.30 + .69 2.95 + .73 
Gain over Initial Test 10.11 + .69 15.47 + .69 


standard deviations as expressed here are in terms of raw scores. On 
Form A the gain in means from the initial test to the test directly fol- 
lowing the reading is 12.41 raw score points or approximately 35 percent 
of the possible gain caleulated from the maximum numbers of points in 
the test. One week later there is a drop in the means of 2.30 points. 
When this loss is interpreted in terms of its probable error, a ratio of 3.5: 
is obtained, which suggests a significant difference. The gain in the final 
test over the initial test is 10.11 points, which is highly significant and 
shows without question that the amount of retention one week after 
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reading a six-page article is considerable. The facts for Form B are 
similar to those for Form A with the exception that the mean gain is 
greater, being approximately 53 percent of the total possible gain. The 
loss after an interval of one week is also greater, as the ratio to its probable 
error is 4.04. 

The intercorrelations that are grouped in Table VI were derived from 
these same data. With the exception of the coefficients for the actual 


TABLE VI 
INTERCORRELATIONS FOR EXAMINATION Xr XITI 


Combination \ B 
Before Reading and After Reading 37 + .09 45 + .09 
Before Reading and Actual Gain —48 + .O8 —41 + .09 
Before Reading and Percent Possible Gain 22 + .10 18 + .10 
After Reading and Actual Gain 55 + .07 59 + .07 
After Reading and Percent Possible Gain 72 + .05 85 + .03 
After Reading and Reading Time 16 + .10 34 + .10 
Actual Gain and Reading Time 13 + .10 69 + .05 
Actual Gain and Percent Possible Gain 95 + .01 73 + .05 
Before Reading and One Week Later 46 + .08 24 + .10 
After Reading and One Week Later 66 + .06 56 + .07 
Actual Gain and One Week Later 22 + .10 17 + .10 
Percent Possible Gain and One Week Later 38 + .09 47 + .08 


gain as one variable and the percent of possible gain as the other, they 

not high and indicate considerable shifting in the relative ranking of 
individuals ‘‘ before reading,’’ ‘‘after reading,’’ and ‘‘one week later.’’ 
The negative correlations between the ‘‘ before reading’’ scores and actual 
gain are indicative of the fact that the students with the lowest scores 
n the first test made the greatest actual gains, while those with the highest 
scores in the first test made the smallest actual gains. The coefficients 
between the ‘‘after reading’’ scores and percent of possible gain are 


‘ 


sufficiently high to suggest that the scores made ‘‘after reading’’ may be 
ised as retention scores when it is impossible to give the examination 
«tore reading and after reading. The discrepancy between the coefficients 
ctual gain and reading time may also be due to the specificity of the 
mtent of Form B and the general character of Form A. The correlation 
form B clearly points to the tendency for the slowest readers to make 
greatest actual gains and for the most rapid readers to make the 
TABLE VII 


AMOUNT OF RETENTION AS MEASURED BY EXAMINATION XI XIII 
WITH LIMITED TIME 





The Evolution of Life The Eugenic Program 
M P.E S.D M P.E S.D 
Before Reading 10.70 + .25 4.00 12.82 + .26 8 90 
After Reading 27.62 + .37 6.04 35.58 + .89 6.45 


Gain 16.92 + .44 22.76 + .47 
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least actual gains. Undoubtedly the nature of the reading material de- 
termines the magnitude of these coefficients to a considerable degree. 

Another group of 125 college juniors and seniors were given the 
Minnesota Reading Examination Xi XIII with definite time limits. That 
is, they were given fifteen minutes for the test ‘‘ before reading,’’ fifteen 
minutes for reading the booklet, and fifteen minutes for the test “‘after 
reading.’’ The data for this group as arranged in Table VII do not 
differ significantly from those just presented. The chief variation is th 
lower measure of central tendency on the initial test which in turn pro 
vides a greater gain, as these students on the average attain the same lev 
after reading as did those individuals who were given unlimited tim 
Since the test was not repeated with this group one week after reading, 
further comparisons are not afforded. 


SUMMARY 

In the foregoing pages, the writer has been primarily concerned with 
the presentation of a method for measuring retention in reading. The 
proposed method forms the basis for the Minnesota Reading Examination 
Xi XII1. The test itself consists merely of an objective examination or 
the text of a six-page booklet. This examination is given before reading 
and after reading the passage. Two forms of the examination were con- 
structed, one containing general material and the other specific material 
When applied to several groups the results from both forms indicated 


considerable gain in information aecruing from the reading process with 


a relatively small amount of loss during an interval of one week. 




















IMPROVING COLLEGE FRESHMEN IN SPELLING 


WALTER 8S. GUILER 

Miami University 
In order to overcome the background deficiencies of college freshmen, 
the School of Education of Miami University has resorted to a program 
diagnostie testing and remedial instruction. This article reveals what 

is been accomplished in the field of spelling. 
Discovering the weak spellers constituted the first step in the program. 
For this purpose the writer’s preliminary spelling test was used. The 
fifty words comprising the test appear in Table I. They were selected 
n a basie list of 2936 words in most common use and sealed on the 
basis of difficulty. In the determination of the content of the basic list, 
those words which were found both in Dr. Ashbaugh’s Jowa Spelling 
Scales and in Dr. Horn’s A Basic Writing Vocabulary: 10,000 Words 
Vost Frequently Used in Writing were included. The score which a stu- 
ent makes in the preliminary test should thus be reliably indicative of 

s ability to spell the three thousand words in most common use. 


TABLE I 
Worps USED IN THE PRELIMINARY SPELLING TEST 


advice advanced advisable lieutenant 

r lining calendar interfere phosphorus 

ace sing choosing privilege ingredients 

ninety counting principal anniversary 
believe grateful sincerely accommodate 

capital superior performed appendicitis 

affair certain mortgage permanent considerably 
t circuit employee materially neighborhood 
receipt beginning assessment administrator 

t attempt convinced excitement affectionately 


The test was made self-ministering by embodying each word in a 
ngful sentence and enclosing the word in parenthesis. Some of the 
‘losed words were spelled correctly ; others were spelled incorrectly in 
their most frequently misspelled form. In taking the test, the student 
was instructed to look at each sentence only long enough to discover the 
| to be spelled, and then to write its correct spelling on the dotted 

t the end of the sentence, as in the samples. 


Samples: 1. John is a (tall) man. ae 
2. Ray is (fore) years old. — See 


The results obtained from giving the preliminary test to 350 entering 
freshmen during the first week of the 1928-1929 college year are pre- 
sented in Table II. The highest possible score is fifty. All of the stu- 


jpnt 


s who did not attain a score of 44 were selected as ‘‘hospital cases.’”’ 
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TABLE II 
Scores Mave By 350 COLLEGE ENTRANTS IN THE PRELIMINARY 
SPELLING TEST 





No. of words Grade Standards 
correctly Fre MM ‘ 
spelled quency Educational Median 
level score 
50 } 
47-49 53 Teachers 
44-46 91 in service 46.3 
41-43 57 
38-4 47 College 
35-37 25 freshmen 42.8 
§2-34 oe 
29-31 21 Grade 12 38.9 
26-28 14 Grade 11 37.6 
23-25 6 Grade 10 34.6 
20-22 4 Grade 9 27.7 
17-19 Grade 8 22.9 
14-1¢ 2 Grade 7 18.2 
yt) 
Average score 40.2* Median score 42.7 
90 percentile score 48.( 25 percentile score 36.8 
75 percentile score 46.1 10 percentile score 29.9 


* 


All computations were derived from ungrouped data 


Analysis of the undistributed seores from which Table II was 
structed revealed several significant facts. First, many of the colleg: 
entrants manifested superior ability in spelling; in fact, approximatels 
one-sixth of them attained a score which is higher than the median score 
for teachers in service. Second, a large number of the freshmen exhibited 
marked deficiency in spelling ability. Out of the total group of 350 stu 
dents, 31.4 percent fell below the standard for high school seniors; 6 
percent did not attain the standard for the ninth grade, which is tl 
last vear of the junior high school; and 1 percent did not reach 
standard for the seventh grade, which marks the beginning of the junio! 
high school. Third, the students manifested a wide range in ability 
spell. Five freshmen made perfect seores, while two students misspell 
34 of the 50 words in the preliminary test. 

Helping each weak speller identify the particular words in the bas 
list which he had not mastered comprised the second step in the prog 
of remediation. This phase of the work was based on the principle 1 
any economical and effective plan for overcoming spelling deficiencies 
must first of all identify for each individual the words which he cannot 
spell in a list of words which he should be able to spell. According! 
each remedial student was given an individual diagnostie test covering 
all of the words in the basie list to which attention was called in th 
second paragraph of this article. This test comprises Part II of A Mas 


tery Work-Book in Spelling and is so organized that it is in reality 
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mnostie self-test. The test was scored by the student with the help 
mastery word-list, which comprises Part I of the student’s work-book. 
h word missed in Part II was marked in Part I by means of a 
s (X). In this way, the words in the basic list which proved difficult 


TABLE III 
DIFFICULTY ENCOUNTERED BY 350 COLLEGE FRESHMEN IN SPELLING THI 
WORDS IN THE PRELIMINARY TEST 


Percent of Percent of No. of ways 
college 8th grade in which 
freshmen students freshmen Point or points at 
W is missing missing misspelled which difficulty 
ed word word* word was encountered 
6 0 l ac 100) Ff 
Q 2 l u ] 0) 
9 3 3 ced (100 
1.1 4 2 ‘ 75 
: I 2.6 8 4 tt 83 pt (17 
affair 2.6 9 ; ir 83 
r 2.9 1: per ( 83 
vast a 12 st l ) 
‘ g 3 7 : g 67 
4 t 4.3 1 I se 
ta 6.0 6 f er ( 21 a 6s 
ed 6.0 19 3 St 
8.0 4 1 I 10¢ 
<. e€ RO 5 I 
t 8.6 9 4 ie 86 
zhborhood +1 15 1 eigh 71 r(17 
tal 9.7 16 4 al 94) 
t 10.3 5 4 ex ( 91) 
4 11.1 18 nn ( 94) 
rely 12 81 _ cere (100 
z 13.4 19 7 os ( 98 
ent 14.6 24 6 e ( 98) 
rably 14.9 30 19 s( 87) ably 7 
formed | 15.1 6 4 er ( 98 
15.4 4 v5 
strator 15.4 29 13 is ( 47) r (27 
g 15.7 19 ni (100) 
“ 17.4 16 e ( 98) 
t 18.9 45 8 ui 95) 
pe 20.9 1 4 al ( 94 
a 9 15 ior ( BR) 
licit 22.9 “ i4 pp ( 31) is (42) 
ally 24.6 46 ~ iall ( 96 
t °6.6 4 10 eipt 99 
4 t 26.9 4 18 ane ( 91) 
advisable 6.9 sa (100 
iff ately 27.1 3 18 ate 88 
ents "9.4 56 14 in ( 76) ients (14 
30.3 23 e({ 9 
age 41.1 40 tg (1 
t 1.7 42 1 8 85) 
f 35.4 49 4 at 7 
36.6 22 t ere 9 
6.9 39 i i (1 
ant 37.1 41 u( 78 
v ary 8.9 f 12 n( 44 ar <9 
ar 39.4 f 7 ¢ A 99 
r 45.1 17 91) 
at ¢ ; 61 7 z 
I s 75.1 72 ’ a¢ 
See the Iowa Spelling Scales, Grade VIIT 
: umber in each parenthesis denotes the percent which the number of students w! 
rd at a given point is of the total number of sspellings of 
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for each individual were identified. Learning could then be foeused or 
individual needs 

Analysis of spelling difficulties comprised the third step in th 
remedial project. The analysis was made on the assumption that weal 
nesses in learning can be most effectively and economically overeom« 
proportion as learners are able to identify the difficult parts of troul 
some words and are then able to focus learning at these points ol 
eult: Each student readily made his own analysis by underlining 
words in his mastery list at the point or points at which they wer 
spelled in the diagnostie test. Table III, which is based on the result 
of the pre liminary test, shows how this phase of the remedial prog! 
worked out in actual practice 

Several facts of significance are revealed by a study of the origi 
data from which Table III was constructed. First, certain words 
sented only one point of difficulty for the gre: majority of freshmen 
miss pt lled them while in other words a considerable percentage Ot st 
dents encountered difficulty at one of two or more points Exampl : 
this fact are afforded by the words lining and appendicitis (see numb 
27 and 32 in Table III). Every student who missed the word lining 1 
Spe lled it bv doubling the letter n ; on the other hand, of the fres! 
misspelling the word appendicitis, 31 percent failed to double the lette: 
and 42 percent encountered difficulty with the last syllable. Second, s 
eral words were missed by a greater percent of college freshmen thai 
eighth grade pupils. Thus, the word ample (see number 25 in Table II] 
was missed by 15 percent of the freshmen and by only 3 percent of eig 
graders. Third, one is amazed at the number of different ways in wl 
college entrants misspelled some of the most commonly used words. 7 
number of different misspellings per word for the fifty words in the p 
liminary test ranged from 1 to 23. The average number of ways in wl 
the various words were misspelled was 7. One-fourth of the words wi 
misspelled in ten or more different ways. The word calendar, which 1 
ceived the average number of misspellings, will illustrate the ingenuit 


with which college freshmen attempt to spell a word which they have 1 





mastered. The number in each parenthesis denotes the number 
freshmen who attempted to spell the word in the way indicated. 1 
misspellings were as follows: calender (59); calander (44); ealand 
29); ealandor (3); ealendor (1); eallander (1); eallendar (1). 


Mastering the words which were missed in the diagnostie test « 


stituted the fourth step in the remedial program. In this phase of t 
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ach freshman poor in spelling studied his own troublesome words 


e was taken to supply the student with an effective té chnique of word 





by encouraging him in his independent study to observe the 
ng suggestions: (a pronounce the word corr etly ind look close ly 
ch syllable as you say it distinctly; (b) close your eyes and try to 
how the word looks syllable by syllable as you pronounce il in a 

¢) open your eyes to make sure that you were able to recall 
rrect spelling ; (d) repeat the two preceding Suggestions as otten 


need to in order to fix the correct form of the word: (e) write 


rd without looking at it just as soon as you are sure that you can 


he correct form, then cheek : I epeat the preced ng suggestion 
three times without looking at the correct form. then check 
rk the word in your mastery list if it is especially diffieult for 


After the student had been equipped with his individual word-list 
na echnique lor word mastery, he was mac realize | 
was his individual responsibility He was also encouraged to 


me when he would be ready for a mast ry test 


final step in the remedial program consisted in giving a maste1 

ch was equivalent in difficulty to the preliminary test. The pr 
retest was to make sure that a high degree of mastery had 
ttained and to obtain an objective measure of improvement. The 
score for the retest was set three points higher than that for the 
nar test in order to counte rbalanee the loss in apd lity which S 
oO oceur atter intensive study has ceased If a student fa ad te 
e retest, he was requirea to go hack to work on | IS i ste 3 list 


IV shows the amount of improvement which was mad 

the 201 freshmen who were assigned to remedial work in spelling 
Tne early part oft the sel} oo] vear, sixtes n withdre VY trom ¢o lear 
ining 185 have been retested. Of this number, 180 have made 


; 


CTtory passing score and have heen r'¢ le: sed irom |! irthe r re medial] 


} 


nalvsis of the data contained in Table IV shows that the great 


the freshmen who remained in college made marked im 
en? In ability to spell the 2OR36 words in most eommon use 
n studs nts made perte et retest seores A]] of the students, except 

Ernest. ‘‘Principles of Method in Teaching Spelling As Derived frot 
Investigation.’’ Eighteenth Yearbook of the National Societ or the Study 


tion, Part II (1919), pp. 52-77. 
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three, made higher scores on the retest than the best score which was 
made by any of them on the preliminary test. All of the remedial stu- 
dents, except two, attained the median score for college freshmen; all, 
except five, attained the median score for teachers in service. The mean 
point gain of retest over pretest score was 11.9, which represents a per 
centage gain of 32.96. The individual point gains are even more striking 
The smaller gains shown in the table need to be interpreted in the light 
of the fact that the better spellers were confined within a narrower rang 


of improvement than were the poorer spellers. 


TABLE IV 








IMPROVEMENT IN SPELLING MADE By 185 COLLEGE FRESHMEN 
Preliminary Individual 
test scores Retest scores points of gain 

No. of No. of Points 

words Fre words Fre- of Fre- 

right quency right quency gain quency 

42-43 36 50 19 32-33 1 

40-41 85 49 45 80-381 e 

38-39 29 48 64 28-29 1 

36-37 19 47 52 26-27 1 

34-35 6 45 1 24-25 6 

82-33 17 44 1 22-2 3 

0-31 13 43 1 20-21 12 

28-29 12 41 1 18-19 12 

26-27 6 38 1 16-17 10 

24-25 3 14-15 18 j 

22-23 > Total 185 12-13 8 

20-21 I : 10-11 22 

18-19 1 8- 9 32 

16-17 2 6- 7 os 

4- 5 13 
Total 185 
: Total 185 

Average 36.1* 48.0 11.9 

75 percentile 41.5 49.4 16.4 

50 percentile 88.7 42.6 10.3 

25 Percentile 32.6 47.8 7.6 

* All computations were derived from ungrouped data 

The following statements, which are confirmed by the data which | 

been presented, are made by way of summary and conclusion. 

1. College freshmen vary widely in ability to spell the words in most 
common use. Some of them spell better than the best one-tent! 
of teachers in service, while others do not possess seventh grad 
ability. 

2. Marked improvement in spelling may be expected from a techniqui 


of learning which first helps each student to discover his ow 
difficult words and then enables him to identify the crucial point 


or points in each troublesome word. 
3. Poor spellers need to be provided with a technique of word master} 
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t. Different students may_encounter different points of difficulty in 


the same word. 
5. Study and practice should be focused on the part or parts of words 
which prove most difficult for the individual students. 














THE OBJECTIVITY, RELIABILITY, AND VALIDITY OF AN 
ESSAY EXAMINATION GRADED BY RATING 


VERNER MARTIN SIMS 
University of Alabama 


INVESTIGATIONS of the objectivity of the essay examination graded 
terms of pereentage are plentiful. The results of these studies 
varied; but Ruch, after tabulating 285 reported correlations betweer 
radings of the same papers, and finding the median correlat 


different g 
‘In view of all 


coefficient reported to be .59, summarizes as follows: 
facets, we must conclude that the central tends ney of the old type | ess: 
examination is toward a reliability objectivity of seoring|* not far fr 
60 to .65; it is certainly less than .70 on the average.’ 

Such subjectivity would seem to suggest that the grading of an ess 
examination is scareely more than a matter of estimating the perfor 


ance of the testee, consequently the writer decided to apply a commor 


ised rating technique to their grading and attempt to determine 
\ssuming the possibility of using such a technique its advantag 
much less time than cor 


Lit 
obvious. Such grading would involve 
and, what is even more important, 


re 
scientious percentage grading; 
would tend to reduce the seeming accuracy of measurement to something 
comparable with the true aceuracy of the procedure 
The general purpose of the problem reported here was to determ 


the objectivity, reliability, and validity of essay examinations when rat 
Practically all of the studies made on essay examinations have been 
Tere sted | the objectivity ot seoring : that is. the have ly en coneer! 


with the extent to which competent judges agree as to the score whic 


articular performance should receive. These investigators have, possibly 


rhtfully, assumed that if the examinations are not objective it is useless 


their reliability and validity \ good examination, hov 
ever, must meet the three eriteria: and unless one has a preconceived 


to Investigate 


ite. ’ summaries of many such studies see: Ruch. G. M The Obijecti 
\ ] } ation (Chicago: Seott Foresman & Co., 1929), Chapter ITI. 
R s the term reliability to indieate either objectivity of seoring (agr 
greement of two forms 


petent judges) or adequacy of sampling (ag 
I take it that in the reference quoted he refers to objectivity oft scoring. 


* Ibid., p. 106. 
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nas to the value ot an essay examination. a well rounded investiga- 
should include not only evidence of objectivity but also evidence of 


lity and validity. 


PROCEDURE 


[he general procedure used in this study was to prepare and admin 
to the same group of students two equivalent forms (Form A and 
B) of an essay examination and an objective test covering the 
subject matter. These examinations were based upon Dashiell’s 
nentals of Objective Psu holoqy, Chapters [IX Motivation , X 
stural Responses), and XI (Intelligent Behavior), and were admin 
{toa group of 80 students who had just completed the unit of work 
tempt was made to cover the same items in the two tvpes of tests 
represented two independent samplings of the material, having been 
ared at different times, and because of the nature of the tests differed 
vy in the selections made from the total material 
Kach form of the essay examination consisted of ten questions. The 
s were made by dividing twenty questions at random. Fifty minutes 
ng time was allowed for each form, and all of the students except 
finished in the allotted time. The questions were typical essay ques 
s as the following samples indicate : 
Form A, No. 1. What is the significance for the problem of learning 
of (a) motivation, (b) attention (c) intelligence? 
Form B, No. 2. What is the relation between motives and habits 
Form A, No. 5. What is attention? Why is it of importance to the 


Ss) chologist ? 


) 


/ . B, No.7. Make one statement concerning each of the following: 
duration of attention (b) effect of distractions on concentrated 

work. 
Form A, No. 10. Of what value are intelligence tests in the schools? 


Form B, Vo. 10. Of what value are intelligence tests in the vocational 


he objective test consisted of 40 true-false statements and 34 com 
tion elements. Fifty minutes was allowed for completing it, but most 

students finished in slightly less time. The average working time 
ipproximately 35 minutes. The coefficient of reliability based upon 
ses and determined by correlating split halves and stepping up this 


iclent by means of the Spearman-Brown Prophesy Formula was .83. 
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For convenience in grading, the essay papers were divided at random 
into four sets of twenty examinations each, and the sets were graded 
(and are here considered) separately. Five readers graded both Form A 
and Form B of Set I, five graded both forms of Set II, six graded both 
forms of Set J/I, and three graded both forms of Set IV. The papers 
were without names, numbers being used to designate the students, and 
no reader knew that Forms A and B were papers written by the same 
student. The readers were: two instructors in general psychology, two 
student assistants in the Psychology Department, and fifteen students 
taking the course in general psychology. The instructors, of course, had 
had experience at grading essay papers. The student assistants had 
never graded an essay examination in general psychology before. Only) 
students having an A or B record in the course were used as readers, but 
eight of them had never before graded an examination paper and none 
of the fifteen had ever graded a psychology paper. The readers wer 
instructed to use the text in working out for themselves satisfactory an 
swers to the questions and then to grade the papers according to the 
following directions: 

1. Quickly read through the papers and on the basis of your opinior 
of their worth sort them into five groups as follows: (a) ver 
superior papers, (b) superior papers, (¢c) average papers, (d) in 
ferior papers, (e) very inferior papers. (Remember that in 
normal group you would expect to have approximately 10 percent 
of very superior and 10 percent of very inferior papers, 20 percent 
of superior and 20 percent of inferior papers, and 40 percent of 
average papers. Do not, however, try to conform rigidly to this 
rule. Your group may not be a normal one.) 

2. Reread the papers in each group and shift any that you feel have 

been misplaced. 

3. Make no attempt to give numerical grades or to evaluate eac! 
question. Place each paper on the basis of your general in 
pression of the total. 

4. Assign letter grades to each group; beginning with A for the 
very superior group, B for the superior group, ete., and report 
the grade for each student. (Report grades on a separate sheet 
Make no marks on the examination papers.) 

The objective test was given to all of the students in the Depa 

ment who were taking general psychology (nine sections of approximat« 

40 students each studying under four different instructors), and 


the basis of the distribution of these scores grades were assigned as 


follows: 
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Sigma Letter 
Range Grade 


1.5le 4 A 
5le to 1.50 B 
.» a to Deo O 
— 5leto — 1.5e D 
— 1.5le - F 


Using this key, the scores on the objective test for the 80 students in 
study were converted into grades. 
By means of calculating coefficients of correlation between the various 
s on these measures evidence of objectivity, reliability, and validity 
secured. Since the grades for both types of examinations were re- 
d in terms of letters the product-moment formula is cumbersome 
for ealeulating coefficients of correlation. Holzinger suggests, in- 
| stead, the use of the coefficient of contingency.* All of the coefficients 
ported here are caleulated by means of this formula. The most serious 
tion to its use is that in a five-fold classification, such as we have 
ised, a perfect relationship is not expressed as +1.00, but as +.894. If 
s borne in mind, however, in interpreting the coefficients, it will 


OBJECTIVITY 


Objectivity is used as meaning the extent to which competent judges 

zree as to the grade that a particular performance merits. Competent 

lges are defined as persons knowing the subject matter and knowing 

the rules for grading. Since graders of objective examinations are 

vs provided with a key and explicit directions for scoring, this is the 
usage as is observed with objective tests. 

The objectivity of the essay papers graded by rating was determined 

orrelating the grades of each reader with the average of the grades 

n by all other readers of a particular set of papers. Table I presents 

se coefficients for each form of each set. The table is read thus: the 

s given by the first reader of Set J, Form A, correlates with the 

ge of the grades given by the other readers of this form .83; the 

des given by the first reader of Set J, Form B, correlates with the 

riven 


erage of the grades given by the other readers .70; the grades 


e first reader of Set II], Form A, correlates with the average of the 


° lzinger, Karl rs Statistical Me thods fo Stude is } catu B ston: 


O79 0°7 





i Co... 1928 » Pl x. 
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grades given by the other readers of this form .83; ete. (It will be noted 


that the same person read Form A and Form B of each set but the readers 
for the various sets were not the same persons. ) 
TABLE I 


CORRELATION BETWEEN GRADES GIVEN BY EACH READER A 
OF GRADES GIVEN BY OTHER READERS 


wT 
‘DD 


SHOWING THI 


AVERAGE 
Set I Set II Set ITI Set IV 
s ‘ PA : : _ =o) ee 
Reader Form A Form B FormA FormB FormA FormB Form A FormB 
1 83 70 83 78 78 77 81 70 
2 81 79 78 75 77 76 76 82 
3 82 70 78 75 75 79 72 81 
4 81 74 79 80 76 76 
5 79 78 78 R80 69 76 
6 82 77 


For purposes of interpretation, since most readers are, perhaps, un- 
familiar with the coefficient of contingency, the distribution tables for 
three selected coefficients (the highest, the lowest, and an average) fron 


this group are presented in Chart I. 


SHOWING DISTRIBUTION TABLES FOR COEFFICIENTS OF CONTINGENCY 


























Cuart I, 
oF .69, .75, AND .85 
F D Cc B \ k D Cc B A F D Cc B 4 
A 4 I I \ 
B l 3 1 ; 1 2 B 1 2 
( 6 2 l ( 2 2 Cc l 7 1 
D l 2 D 1 3 D l 1 1 
F 2 l l } 2 l I 3 
C of C = .& C ot C = .75 C of C = .83 


Although these coefficients vary a great deal and are not extremely 
high, they are (accepting Ruch’s statement) superior to those found when 
examinations are graded by percentage. The average coefficient found 
is .77, and the range from highest to lowest is only 14 points. The prob 
able error of the coefficients was not found, but this range of 14 points 


is almost surely less than five times the average probable error. * 


RELIABILITY 
Reliability is here used to indicate the consistency of the performance 
Obviously the subjectivity of the grading will reduce the 


of the testee. 
reliability, but with the grading system used what agreement is there 


between the grades given by a particular reader on equivalent forms of 
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This reliability was determined by correlating the grades given 

each reader on Form A with those given by the same reader on 

Form B. In addition, the coefficient for the average grade given on 

Form A with the average grade given on Form B was determined for 

set. These last coefficients might be interpreted as the reliability 

would tend to be found as the subjectivity of the grading was 
dueed 


[hese coefficients are presented in Table II, and, for comparative pur- 





oses, the coefficients of reliability for the objective test used are also 

resented. These coefficients were determined as follows: the objective 
was split into random halves and, on the basis of the distribution of 
scores on the half, letter grades were determined for each half by the 

me procedure as that used above for the total test. The letter grades 
le by the students in each set on the two halves were then correlated 
means of the coefficient of contingency and this coefficient stepped up 

th the Spearman-Brown formula. Holzinger states in a private com- 

inieation that this stepped-up coefficient may be interpreted as the 
mum coefficient that would be found. 





TABLE II 


Ss 1 CORRELATION BETWEEN GRADES ON ForM A AND GRADES ON Form B 
¥) FOR EACH READER AND FOR THE AVERAGE OF ALL READERS 
Set I Set II Set ITI Set I\ 
Reader (A-B) \-B) A-B (A-B 
1 67 72 69 73 
2 73 74 73 71 
3 69 76 71 69 
4 69 73 74 
5 73 67 79 
6 67 
‘ Average Grade 
| All Readers 70 78 73 71 


Objective Test 
Stepped-up Relia 
bility Coefficient 78 83 74 87 


\s would be expected, since lack of objectivity reduces the reliability, 

these coefficients are lower than these found for objectivity; but they 
re still relatively high, the range being from .67 to .79 and the average 

efficient (.72) being but nine points less than the average reliability 


. 


efficient 81) found for the objective test. 


VALIDITY 

e Evidence of validity is not so easily obtained. For purposes of this 
tudy we will define validity as the extent to which the essay examination 
measures the same thing that an objective test over the same subject 
, matter measures. Perhaps the confirmed addict to essay examinations 
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would consider this doubtful validation, but it seemed desirable to deter. 
mine the extent of agreement between the two types of tests. The 
standard nature of the grades on the objective test, due to their being 
based upon the distribution of seores made by approximately 450 students 
studying under various instructors, gives added meaning to such a 
procedure. 

The correlation between grades on the objective test and grades given 
by each reader of each form of the essay test are presented in Table ITI 
The correlation between the average grade for a form and grades on the 
objective test, and the average of both forms and grades on the objective 
test, is also presented for each set. These last coefficients should be inter- 
preted as indicating the correlation that would tend to be found as the 
objectivity and reliability of the essay test was improved. 


TABLE Ill 
SHOWING THE CORRELATION BETWEEN GRADES ON THE ESSAY EXAMINATIONS 
AND GRADES ON THE OBJEUTIVE TEST 





Set I Set II Set IIT Set IV 
Reader Form A Form B FormaA Form B Form aA Form B Form aA Form f 
1 72 61 77 69 75 70 .68 7 
2 67 63 69 70 70 71 62 6¢ 
3 63 62 74 75 71 75 67 6 
4 65 66 69 78 71 68 
5 66 68 73 81 81 68 
6 69 .65 
Average All 
Readers 67 .70 .76 82 75 .74 65 7 
Average All 
Readers, Forms 
A and B 
Combined 73 78 82 75 


Since neither of the examinations used has perfect reliability on 
would not expect to find perfect agreement. The maximum correlation 
expected would be equal to the square root of the products of their relia 
bility coefficients. Using the average reliability coefficient found for th 
essay test (.72) and the stepped-up coefficient (.81) for the objectiv 
test the maximum possible correlation would be \/.81 X .72 = .77. The 
oefficients for the individual readers range from .62 to .81 wit! 
average of .70. We thus see that within the reliability of our measures 
there is high agreement between the two types of examinations. (In 
passing it should be mentioned that this high agreement between t 
essay and objective test, coupled with the greater reliability and obje 
tivity of the objective test, might well be interpreted as meaning t! 
the objective test is a better measure of the same thing that the essa) 


examination measures. ) 
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SUMMARY 
essay examination graded by rating was found to have an average 
ent of objectivity of .77 which is considerably higher than the aver- 
efficient reported by Ruch for essay papers graded by percentage 
average coefficient of reliability found was .72, which is approxi 


1) points lower than the reliability of an objective test over the 


te? 


subject matter and demanding slightly less testing tims 
verage correlation found between the essay examination and a1 
e test over the same subject matter was .70, which is within seven 
the correlation that ‘he reliability of the tests would permit 


e\ denee presented he re 18 too meager to permit the dt iwing of 


onclusions, but the findings are promising. The objectivity of 
ng is certainly not yet what one would desire. The relatively 
yreement (as compared with the objectivity between the grades 


ms would Suggest t] iT the unre hahbil tv was prineipa ly due to 


of grading rather than to limited sampling. The high corre 

tween the essay grades and grades on an objective test would seem 

t mastery ot subject matter rather than such things as 
punctuation, spelling, handwriting, ete., is being measure 

relative nature of the grading means that its use is limited. To 


} 


ndividual from one group and place him in another would meat 


position and consequently his grade would change. The method 
reely be used for the comparison of two groups unless the papers 


led together and graded. But, for ordinary examination pur 


one 1s convinced that essay examinations test for abilities which 


e tests do not reach. or de velop abilities which the \ do not de velop. 


ild seem that such a grading method is worthy of further con 
on. The writer is st present experimenting with the possibility of 


ing the measurement through refining the rating technique 
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A COMPARISON OF THREE METHODS OF COMPUTING 
COMPOSITE SCORES 


EDWARD F. POTTHOFF 
University of Illinois 


It is a well known fact that a variety of methods are now availabl 
for representing a pupil’s attainment on a group of tests by means of 
a single composite score. The relationships which exist among various 
types of scores, however, are not always clearly understood. It is th 
purpose of this article to consider the nature of three types of seores 


nT 


ot w! ich are based upon the same test and involve the Same groul 


students 


The individuals concerned in this study consist of six hundred st 
dents to whom was administered the 1924 edition of the Psychological 
Examination which is edited by the National Research Council his 
Examination consists of nine separate tests, each of which yields its « 
score The examination provides that a composite score be determin 
in the following manner. Percentile ranks are computed for each test 
so that each of the nine raw scores earned by a student may be « 
verted into Its corresponding pe reentile rank The median of the 


percentile ranks is then found, this median being used as a single in 


of attainment in the entire examination. 


| tng $ 


A second method of computing a composite score is to find the to 


of the raw scores earned by an individual on the nine tests. Under this 
procedure the various tests have equal weights in determining the con 
posite score only when the variabilities of the tests are equal or app 
mately equal. The tests under consideration do not have equal va 
bilities, however, since their standard deviations for the group stud 
range all the way from 3.34 to 18.65, this large range being due chiefly 
to the fact that ‘‘perfect’’ scores on these tests range from 15 to lol 


A totaling of the raw scores on these tests does not, therefore, res 
in giving them all equal weights. 

A composite score which does give equal weights to all of the 1 
may be obtained by converting the raw or original score on each test 
into the corresponding standard score, and then finding the sum otf 1 


standard scores earned by an individual on the nine tests, the resulting 


total being used as a single index of attainment in the entire examinatio! 


224 . 
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method, of course, is an extremely laborious one, but it is also com- 
regarded as the most accurate. 


purposes of this study each of the three types of scores just 


bed was computed for each of the students tested. These scores, 
ter. will be referred to as the pe reentile scores. raw scores. and 
rd scores, respectively. The standard scores were modified so as 
negative quantities and large numbers. This modification, of 
does not affect the results in any way. 
parisons among the three types of scores were made in two ways 
representing the distributions of the scores in a graphic manner, 
md, by computing coefficients of correlation and correlation 
rure l shows the distributions of the seores of the SIX hundred 
ts when the percentile scores, the standard scores, and a normal 
tion? are used, thirteen class intervals being employed along the 
e in all cases. The raw scores are not shown because the dis- 
n in this ease is very similar to that of the standard scores 
s evident at once from Figure 1 that the distribution of the stand- 
res approximates the normal distribution much more closely than 
it of the percentile scores. The latter tends to be rectangular, all 
frequencies from the third to the eleventh class intervals inclusive 
vithin the range 49 to 67. Such a result is to be expected, of 
because of the way in which the percentile ranks are calculated 
gular distribution is the result of the mechanics of computation, 
efore, does not necessarily give a correct representation of the 
tion of the traits measured. It has been found that psychological 
listribute themselves normally rather than rectangularly when 
nselected groups are used, and in view of this fact it appears 
e standard scores are more nearly representative of the facts. At 
stribution in this case is much the more normal in appearance. 
order to determine whether or not there were any other significant 
es among the three types of scores studied, a number of coeffi- 


‘ ecorrelation and correlation ratios were computed. The correla 


ween the raw scores and the standard scores was .952 + .003. The 
nt between the percentile scores and the standard scores was 
003, and the correlation ratios were .948 + .003 and .951 + .003. 
efficient between the percentile scores and the raw scores was 
005, and the correlation ratios were .916 .004 and .927 004 
normal distribution was obtained with the aid of the table on ‘‘ Areas and 
es of the Normal Probability Curve,’’ found in Holzinger’s Statistical Tables 


de 5 7 Education and Psychology, pp. 70-71 
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,. uw ss azseh6hasemhUCmSthCereemhlhc el Ole | CU 
FicureE 1. Scores or Six Hunprep Srupents DISTRIBUTED ACCORDING TO: P l « 
CENTILE Scores, STANDARD SCORES, AND A NORMAL DISTRIBUTION. THI 
CONTINUOUS LINES REPRESENT THE PERCENTILE SCORES, THE DOTTED 
LINES THE STANDARD SCORES, AND THE BROKEN LINES () 
THE NORMAL DISTRIBUTION 


When Blakeman’s test for linearity is applied in the case of the rela- 
tionships found between the percentile scores and the standard scores 
the results are 2.22 and 2.63. When the same test is applied in the cast 
of the percentile scores and the raw scores, the results are 2.21 and 3.35 


It appears, therefore, that the relationships in both cases tend to 


curvilinear rather than linear. 
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view of the fact that the correlation between two sets of ¢ quivalent 

es is frequently found to be as high as .98, it appears that the 
efficients of correlation found among the three sets of seores used in 
study were relatively low. It should be noted, however, that the 
icients of reliability of our intelligence tests are usually not above 
nd are rarely higher than .95. It is safe to assume then, that the 
bility of the Psychological Examination is not higher, and is prob 
ower, than the coefficients of correlation found among the per- 
raw, and standard scores. In other words, any one of these 
nethods of scoring is probably more accurate, when either of the 
two methods is used as a eriterion of accuracy, than is the test 
1S a Measuring instrument. It follows, therefore, that the three 
scores may be considered to agree v« ry closely with one another 

t they may be used interchangeably with chance of only slight 

[t should be remembered, however, that because of the naturs 
percentile scores, their distributions and their relationships to 
sets of measurements may be affected in the ways already shown 


THE PSYCHOLOGY OF THE TABLE OF CONTENTS 


J. HowarRD STOUTEMYE! 
Onarao. Illinois 


*ROFESSIONAL journals render an invaluable service both to those in 
profession and to those in training. This service, however, is not 
nensurate with their real worth for their perusal is over-limited 
the proper placement and arrangement of the table of contents 


se this perusal? The following data attempt an answer 


I THE PLACEMENT OF THE TABLE OF CONTENTS 


e placement of the table of contents in fifty-five journals in edu 


5 tion and closely allied fields is as follows: 35 on the outside front cover, 
he outside back cover, 3 on the inside of the front cover, 14 some 
prec ding the reading section, and 2 following the re ding sectio1 

Ot the 20 that place the table inside, 6 place leading articles on the front 


t place pictures or designs, 2 use it for advertising, and the 


caer for the box rd of editors 


g W t is the effeet of the placement of the table of contents on the 
sf he cover on regular or casual readers? To secure an answer 
Q e to twenty educational journals, and received eighteen replies 


he briefly summarized thus 1. Onlv one had definite data 


S ourna! substituted a Tew leadin r rticles on the tront eover 
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for the board of editors, favorable comments were received. 2. Present 
usage is justified on long continued usage. The law of habit would mak 
this effective for regular readers. 3. Each editor expressed his theory. 
A few types follow: One felt that an illustration or design on the cover 
was necessary to attract attention to the contents of the journal. ‘‘ W; 
believe the publication of the table of contents on the cover is a well 
established practice.’’ ‘‘ We believe, if we cannot prove, that the custom 
is helpful.’’ ‘‘My general impression is that readers prefer the table oi 
contents on the front ecover.’’ ‘‘I have no data, but, theoretically, I se 


ay 


definite advantage.’’ 

Through the courtesy of the Journal of Educational Research, v 
questions were sent to its subscribers. Of the fifty replies, forty-sever 
were very heartily in favor of the present practice, two felt it was an i 
question, and one preferred a few leading articles and the full tal 
inside. A third of the forty-seven stated: ‘‘I like it,’’ ‘‘I heartily cor 
mend the policy.’’ About half stated: ‘‘It saves time,’’ or ‘‘It is mu : 
easier to see whether the articles are of a nature to appeal to me.’’ Thre | 
mentioned the greater ease in looking over back files when they sought | 
materials on a problem. Two librarians found it aided in finding ref 
ences for students. They report that casual readers read more than the 
would otherwise, for a flashy title or a well-known name attracts thei: , 
attention. While this number of replies is too limited to warrant gene! 
conclusions, we can state that this group favors the placement of t! 
table of contents on the front cover because it saves time, it aids in selé 
ing topics of interest, and it aids in looking over back numbers. (Ger 
eral magazines, competing with two hundred others for public patror 
at news stands, find an attractive cover necessary for effective news sta 
appeal. Since professional journals have a relatively small news sta! 
sale, it would seem that cover designs should be for the convenience 
subscribers rather than for the casual purchasers. 

From a number of experiments on the placement of advertisements ‘i 
magazines, Starch? concludes that the outside covers have about thre 
times the value of inside positions, though the pages next to the cov 
and those facing the reading section are preferred inside places. Fror 
composite graph of the studies of Adams, Starch, and Strong, the bac} 
eover has about two-thirds the drawing power of the front cover ai ma 
the intermediate pages less than half. Starch explains these data 

‘Starch, D. Advertising, p. 112. 


999 


7 Adams, H. E. Advertising and its Mental Laws, p. 222. 
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rrounds of (1) primacy, the first part of the magazine to be seen, 
iency, the greater number of times it is seen, and (3) vividness 
‘ is less distraction from competing stimuli. The too. the right 


re has nearly twice the drawing value as the left. Since five of 
\W\V I A zines used left hand pages. their tables of co tents wo 1 not 


drawing power. As an advertisement of the contents of th 


placement on the front cover has many advantages The next 


ee seems to be the first right-hand p: 


I LEGIBILITY OF THE TABLE OF CONTENTS 


if comprehension is a chief factor in si eur 1? g attention. nd 
ds on the legibility of type. Legibility depends on the form of 
rs, size, heaviness of fac of typ and width of the white margin 
ng it ‘‘(Certain faces oft type ire much more leg vf, than 


es,’’ and ‘‘the relatively heavy-faced tvpes proved more legibl 


light-faced types.’"* For example, bold faced Cheltenham can 


t 286.2 centimeters as against 259.6 for the Italie. Although 
ved a loss of one-eighth. there were several jour? ils that use the 
T tlhe S Aceording to the judgments ot Two nny are qd sti ¢ nits 


f of these m iwazines eould increase the effective ness of their 


tents by using more legib] Lv pe [ e Same coneluslor would 
e of the spacings between words and titles. No doubt color makes 
more attractive : but great care must be exercised to see ire 
ntrast between the color of the eover and the type (ne 
SCS hig t gray cove ! | lig 1 Italic t ( no ey seq 
row over and a dull black in n neither eas e econtras 
legibility 
| ire sometimes used effectiv: ly to separate porti s of the eon 
h s the title of the jour I | the TOD. The table oT e tents 17 
of the cover. and the publisher at the hottom. Tyines ; m, 
rders which serve the purpose of a frame of a picture by shut 
t competing stimuli. An effective border also s 
where many different headings are displaved 


IT THE PLACEMENT OF THE NAMES OF CONTRIBUTORS 
mati ¥ umber of mavazi es ¢ ithe? nlace t} e@ auth r’s } me first o7 


nt it in a larger or bolder tvpe In general, readers look first 


thlein, Barbara Elizabeth. ‘‘ Legibility of Different Faces of Printing Type,’’ 


Journal of Psychology, XXIII (1912), pp. 1-36 
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for the topies and then for the author; hence the topies should be made 


prominent by position and legibility. 
Although general practice places the title and then the author’s name | 


in the body of the magazine, there are a number of journals that plac 
the author’s name following the article. There seems to be a distinct 
gain in favor of the practice of placing the author’s name immediat: 
following the title, for it saves looking back to the table of contents 
to the close of the article. 

During its latter years, the Educational Review placed a short intr 
ductory item about the author immediately below his name. For joun 
with a large circulation and many new contributors this has real valu 
For several years the American Journal of Sociology has placed a brik 
abstract of the article immediately following the author’s name. TT! 
enables the reader at a glance to catch the major problem discussed 


Summaries or conclusions at the close of the article are also felt t 


worth while. 
IV. CONCLUSIONS 
1. The placement of the table of contents on the outside front cover 
of professional journals has much in its favor. 
2 The table of contents should have a clear but not over large tit 
3. The data of issue, year, and volume should also be easily read 
+. The title of articles should be printed in clear, legible typ: 
lowed by the author’s name and the pages. \J 
5. When colored covers are used, there should be a sharp contrast ay 
with the type used 
6. Lines are helpful in focusing attention and in securing unit) 
the table of contents. 
7. The board of editors and other business matters may well 


placed on the inside of the front cover, as a number of journals now 
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RESEARCH IN HIGHER EDUCATION 


ition, methods 


(‘URRENT interest in problems of curriculum reorganiz: 


ing, and administrative procedure at the college 
to a considerable extent the result of a rapid inere: 


S te 
ment sinee the late war 


vider range of individual! differences, needs, interests 


and university 
ise in student 


This influx of a less select student body, 
and capael 


| the resulting expansion of a limited curriculum and modifica 


i 


inflexible methods of teaching have introduced perplexing prob 


for solution in higher institutions. 
\ irge amount of educational literature coneerned with such prob 


The United States Office of Edueation 


igh r ¢ du 


is been accumulating 3 
ng a bibliography of some 13,000 titles in the field of h 


National edueational and learned associations and foundations 
en active in the promotion ot investigations at the college ievel 
1 in this 


‘ 
Numerous surveys of higher institutions have been conducted. To 
Minnesota experiments 


(0, eighty-two books, monographs, and bulletins appeare: 


nly a few major studies, there are: the 
ss size and science teaching, the Land Grant College Survey, the 


Foreign Language Study, the Commonwealth Teacher-Training 


i the National Survey of Teacher Education National found: 


na 

| societies, denominational groups, regional organizations, state 

ents, teachers associations in subject-matter fields, and ind 
leges and universities have promoted intensive surveys of the 


nstitutions involved The edueational pe riodieals dealing with 
e and university problems now include: Journal of Higher Educa 
Junior College Journal. School and Society. Educational Admin 
na Supe rvision, Liberal Arts College Bulletin. and Bulletin 


issocialt on of Amer an Coll ges 


oregoing facts imply that a wealth of material is available for 


iversity Courses dealing with problems ot highe I edueat on 
the summer of 1931 twenty-four universities offered courses in 
| for administrators, teachers, and graduate students. There is 
SI laV al qd understanding of proble ms in highe r ed iwatiol the 
workers at hot} eollege and high schoo leve S ‘el madal ‘noo 








232 JOURNAL OF EDUCATIONAL RESEARCH [ Vol. 24, No. $ 


principals and teachers who know the entire educational system are able 


' 
BS 


to provide more adequate opportunity and guidance for high-school pupils 
who expect to enter college. Such courses are of especial interest to can- 
didates for the Doector’s degree in view of the fact that 75 percent of 
this group after graduation go into college or university work. Mar 


Yl MY Be My 
Sa t/a to ot 


of these students work out theses concerned with college problems. From 
1918-1929 there were completed 244 Doctors’ theses dealing with p 
lems of higher education. In 1930-1931 there were under way 181 
Doctors’ theses in higher education. 

Does this rather formidable statement of investigational activity 
the college level mean that most of the problems in this field have beer 
solved? Not at all. Especially is evidence lacking concerning the merits 
of certain teaching and curriculum innovations at both graduaté 
undergraduate levels. The writer has been impressed by the absence « 
such objective evaluation in collecting from higher institutions mate: 
for the Department of Research News and Communications of this 
journal. At the graduate level, in objective terms, what are the merits 
the Iowa plan of individual or independent study, of the Yale seminar . 
ganization, and of the new degree programs in education as described 
the 1931 yearbook of the National Society of College Teachers of Edu 
tion? At the undergraduate level, on the basis of experimental evaluatio: 
what is the evidence coneerning Rollins’ workshop or laboratory plan, ‘ 
cinnati and Antioch’s codperative or part-time programs, Harvard 
Princeton’s general reading and tutorial plans, Stanford’s independ 
study scheme, Swarthmore’s honors courses, Wisconsin’s Experiment 
College, and Chicago’s divisional reorganization ? 

Granted that administrative difficulties may seem almost insurm 


able and variable factors apparently uncontrollable, the challeng 


evaluate these plans on an experimental or factual basis remains for 1 


student of objective measurement. Minnesota’s work with class size 


science teaching is a good beginning in this experimental program 
must be kept in mind that scientific evaluation does not consist 
opinions collected from parents, students, or teachers with respect to 1 
merits of a given plan; neither is it journalistic description of 
methods in use; it is not even analysis and criticism based on observat 
and painstaking rationalization. Of just what scientific evaluation do 
consist is a long story that has been reasonably well told in curr 
volumes which deal with techniques of measurement, experimentati 


statistics, and educational research. 


CaRTER V. Goop 
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THORNDIKE, Epwarp L. Human Learn- 


ing, New York: The Century Co. 
latest 


book and should prove especially inter- 


This is Professor Thorndike’s 


esting to laymen in that it is a non-tech- 


nical discussion of certain facts and 


principles pertaining to the learning 
process which the author has brought to- 
gether during many years of investiga- 
tion in the fields of both human and ani 
mal learning. 

The first ten chapters are revised lec 
tures dealing gvith the nature of human 
learning With one fell swoop, the au 


thor disposes of ‘‘adjustments,’’ ‘‘ con- 


‘*integrations,’’ 
** purposes, ’’ like 


by saying that ‘‘all of these facts seem 


figurations,’’ ‘‘ drives,’ 


‘*tensions’’ and the 


to me to be reducible so far as concerns 
their powers to influence the course of 
thought or feeling or action, to connec- 


readinesses in the nervous 
The 


system.’’ 


tions and to 


system. Learning is connecting. 


mind is man’s connective 


Page 122 

The physiological basis for this theory 
is equally simple and, as the author him 
self admits, highly speculative, (as in 


deed are all physiological theories of 
learning). Each neurone is supposed to 
live much as 
one-celled 


changes of position being restricted to its 


would an amoeba, or any 
animal, with all movement or 
enas Since a neurone’s life processes 
consist of receiving and transmitting 


stimuli, any synaptic bond, the conduc- 
which 
affairs,’’ 
and those which produced ‘‘ satisfaction ’’ 


would be 


restatement of his old hedonistic and as 


tion across I roduced 


‘annoying 


states of would be given up, 


maintained. And so we have a 


sociation theory of learning, supported, 
however, by much new ex perimental data 
that gives a certain evaluation or weight 


to his theory. This theory he now restates 


this experimental data 


n the light of 


[ Vol. 24, No ; 


and the numerous criticisms that hay: 
been directed towards it in recent years 
by Gestalt psychologists and other work 
ers in the field of learning. 

The last 


are concerned 


two chapters of the book 
with the 


learning and its future possibilities. 


evolution of 


**Man does not, so far as we know 


have new varieties of neurones or new 
modes of action of neurones, but he does 
have many more of them with far greater 
possibilities of interconnection than exist 
in other animals.’’ (Page 168). This 
fact is made the basis for his quantita 
tive theory of learning. This ‘‘ quant 
tative difference in 
eo producer of the qualitat 
differences which we call powers of i 

tion, analysis, abstract and general 1 
tions, inference, and reasoning.’ 


The outlook 
is optimistic. For as the author puts 


presented by the b 


‘*We still have much to learn about « 
** but 
that with selective breeding within 1 


genics,’ even now we know 


generations, we could hope to have 
race of men whose average would 


much nearer to the intellect of Newt 


Pasteur, Gladstone, or Edison than t 
that of the average man of to-day 


Thorndike ’s 


the nature and evolution of man’s k 


Professor discussion 


ing process explains many fundament 


facts and principles of human learning 


in the light of significant experiment 


data obtained from investigations 


ried on during the past three years 
These principles and facts are expla 
in clear and simple language that s! 


The book vy 


the best statement of the author’s the 


be understood by all. 

of learning that he has ever made 

a complet 
The es 


tablishment of new habits or connect 


however, present 


does not 
count of the learning process. 


by the action of conditioning stin 


associative learning 
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sketched, and the relation of wholl ignored: and the relations! ips 
mental type of improvement to with which they deal are usually normal 
g process as a whole is not and wholesome Compositions from chil 
W. F. Boox dren of five, six, seven, and eight years 


University of ag 





the verage st I ing 66.6 words 
— Content and Form of the contain Tr ym to Sixty nine 
Compositions Dictated by thought units, wit! . ediar f 7.29 
om Five to Eight Years of ‘#eY are usually given titles; they 
lew York: Columbia University, serve time sequence; they have conclu 
— « sive endings, some repetition to heighten 
sin impressions, some characterization, co 
i study of the original com versation, and unusual phrases; and they 
f 1,215 children, ranging in pa more attention oS ee. Oe he 
five to eight years. These sense aspects 
elected from sixty-six class The stud} further points t some 
ted in ¢ le ver communities n nteresting * ete ab ‘ the nere ac 
vere a cosmopolitan group, decrease of certain characteristics witl 
nr Ri ae ns. and neg eS the progress - . 
ly mingled with Americans parison of aculine and fe satan ‘ 
‘ the la ear g repre the o 4} a 
nition f more than té fn the Mobi ® thie : os . 
t s, but thirty-seven after reful ex —_— , sting 
1 in towns with smaller po textbooks. « ses of study ' ks 
! thods, Dr. Bet mes to the 
ldren dictated their stories t conclusion that education is putting t 
petent and sympathetic adults, much stress upon securing uniform prod 
reful to read the compos icts She believes that the children’s 
t their young authors as willingness to dictate stories t thers is 
lesired After the grossest n indication that artificial elaborate 
rs had been corrected and devices for securing original compos 
sitions themselves had been tions re nnecess: She furthe ‘ 
these stores were ar ilyzed lieves that too manv subiects s ogested 
similarities and differences in for composition work ept as a fact 
| torm the lea contradicted 1 r e atnd that 
ner reaches several interesting a child is most interested in stories in 
n this study Children in which he himself is the hero. The study 
ears of school show greater indicates also that childrer re far more 
duy lication in the choice of interested in narrative than nh essay 
hey have a greater liking for writing, and the author recommends that 
story than for any other less of the latter type be requ red In 


igh they do not wholly neglect school J. HELEN CAMPBELI 
descriptive, rhythmical, and Miami University 

hods of composition. For 

irt, children tell stories whicl MEIER, LOIS Natural Science Education 

rst hand experiences, imagina in the German Elementary Schools 


+ 


erary experiences not being New York: Burea f Publications, 
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Teachers College, Columbia University, 
1930. vi 
Miss Meier’s 
schools was made during thirteen months 


158 pp. 
study of the German 
spent in actual contact with the schools 
in which time she also had opportunity 
to take courses in the changes which are 
going on in the German system. 


pages of this vol- 


hundred 


The first 
ime outline the science work in the ele 
schools and in 


third of the book is 
training. The last 


mentary the secondary 
schools. The last 
devoted to teacher 
chapter deals with a comparison of the 


German and American work in science. 


Comparing the science work in the 
first eight grades of typical states in 
this country and in the corresponding 


school level of Prussia, Miss Meier finds 


that California devotes from 1 to 2 per 
cent of the total teaching time of grades 


I to VIII t science ; Massachusetts de 


votes T I if S percent: and New Jersey 
3 to 5 percent while Prussia gives from 
17 t 9 percent Thus, California de 
votes 185 minutes per week to science 
instruction s the total for the eight 
grades Massachusetts devotes 600 min- 


$40 minutes and Prus 


There is a similar contrast in the time 


devoted to seience in the 


secondary 


schools. The student must take some 
science every year during the nine years 
of his secondary school course. This 


totals 35 year hours of instruction in the 


course and 18 year hours in the 


On the whole, the girls 


classical course 
have more science than do the boys, de 
voting more time to biology and less to 
phvsics. 

The subject matter of science instruc 
tion in the elementary schools is not very 
different 


from that in our own nature 


study though it does deal more with ma 


terials that are of industrial value. The 


[Vol. 24, No.3 


method of instruction in the elementary 
school is largely through walks, the 
pils recording their studies in permanent 
notebooks. The method of instruction 
the secondary schools is quite similar 
that of American institutions excepting 
that the work is presented largely by the 
demonstration method instead of by 
individual laboratory method. 

Even for the elementary schools, th 


£ 


German teacher must have taken at lea 
two years of training beyond the Ger 
certificate 


man schools, the 


secondary 
from which is about equivalent to 
junior college certificate. Since scier 


is required throughout the secondary 
school, every teacher will have had s 
Miss Meier 


trasts this situation with figures quote 


from Miss 


training in science. 


silig’s study on the prey 


tion of students enrolled in va 3 


training institutions in the 


Only 54 percent of thes 


teacher 
United States. 


students had had any biology, 37 
cent having had it in high school; 43 per 
cent had had physics, 41 percent in | 
school; 42 percent had had chemistry, 
The percentag 


percent in high school. 


in other sciences was considerably low 
er than for these three. 
After completing the course at the 


teacher training institution, the young 
teacher undergoes a two year systen 
training in service under the state 
partment before he receives a permane! 
elementary scie! 
E. R. DowNING 


University of Chicago. 


appointment as an 


teacher. 


JAMESON, EMILy D. Physical Educatio 
for the Preparation of General E 
mentary School Teachers. New York 
Teachers College, Columbia University 

1930. viii + 118 pp. 

The elementary school teacher is being 

education 


teach I hysical 


xpected to 








i 
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wi 


nsibility 


Di 
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+} 


of rapid 


nsidered by 


appropriate age 





Out of four 
the 


h her other duties. 
development of 
i physical education program, 
s emerging as a desirable prac 
many as a special 
ealth and 


physical education, 


few representatives as 
fie]d. 
al opinion, at present, believes 
should have 


for this as for other 


ichers in the .elementary 


teacher 


assroom 


e training programs of the 
nor ial schools and colleges 
rricula were 


npl 


14); that specific training in 


activities 


been no 


class 


adapting ac 
groups 


the 


is one 


s stressed in theoretical 
1e physical education courses 
activity courses one is startled 
ttball, basketball, 


and tennis 
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taught in profusion! No wonder we 


football midget teams and children of 


tender years playing basketball befor 
their hands are large enough to hold the 
Jameson makes a heroic 


tempt to show, in her concluding chapter, 


pro 


without a curriculum analysis, 


the inadequacies in the training 
grams but 
using school situations and scientific ev 
dence on age capacities, there can be | 
tle help given the problem. 

Had not Dr. Jan 


dissertation she undoubtedly would have 


ieson been writing 


omitted a great amount of in 


tial statistical material. 





been thorough, perhaps meticulous, in her 
task, but the material presented is 


small 


part of the whole program that 


ther evidence iS necessary in or ler to 
See ] l the Sit if I One feels 
perhaps, that the title of the book is a 
misn er Tr} l rye pr ble remains 


entire book written on the thought in the 





last sentence of he second chay ter: ‘<Tt 
3 ed that all institutions will 
eventually to differentiate at least one 
year of the r physical education SO that 
ea h «¢ uUTSE will be es pec ially T ed to 
prospective teachers of some Specific age 

el D. OBERTEU! 

State Depa tment o Educatior 


LOWTH, FRANK J. The Country Teache 
at Work. 


lan Cor pany, 19030 541 DT 

Perhaps the most itstanding ch: 
teristic of this book is the evidence, on 
st every page, of the author’s inti 


mate acquaintance with rural needs Ar 
other compelling feature is his whok 
philosophy of education and < 

sense s&s 


iggestions for 


One finds himself again and again men 


_ — 
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tally noddin assent to the clean cut and 


viyvorous 


method throughout the book. More 


statements of purpose and 


over, the author indulges but little in 


high sounding phrases His illustrations 


ire usually drawn from experience; his 
suggestions are practical, and he meets 


_ 


rural education at its worst—the one 


There are some features of the book, 
wever, which seem to merit less com 


mendation 


For example, the chapter of 


some fifty pages on ‘‘ Keeping Records 
al Making Re ports ’ has some very ex 
cellent suggestions, but a large part of 


s taken up by printed forms and 


standard items Rural teachers as a rule 
have very little to do with selecting the 
f f the records used and hence 


would have onlv a very general interest 
except in the particular records 
Likewise, 
the chapter on ‘‘ Thrift For Teacher and 
Pupil’’ seemingly would be more adapted 
to an upper grade pupil’s textbook than 
to occupy space in this book which for 
the most part presents materials both 
‘useful and usable’’ in the midst of 
classroom activities It may be that 
sheer prejudice prompts the criticism of 
the general organization of the book, even 
ti ugh knowing the theme ‘«Obijectives’’ 
ins through the book, one ’s sense of 
order is jarred by having a most stimulat 
ing discussion vitally related to class 
roon pro edure on ‘* Personal Influence 
in Disecipline’’ followed immediately by 
a chapter on how to save money, with 


its budgets, compound interest tables, 


et This does not say that the thrift 


[Vol. 24, No 

idea is not good, but it is not usually 
yoked 80 closely in teachers’ books with 
the discussion of essentially schoolroor 
Other parts of the book show 


the same tendencies. In one sectior 


activities, 


Reading’’ is listed under ‘‘ Instru 


tional Objectives,’’ the following section 


is entitled ‘‘ Realizing Objectives’’ a 
‘*Tools and Skills.’’ Certainly 


**Reading’’ is a ‘* Tool’’ subject and is 


covers 


used fully as much to ‘‘realize ob 
tives’’ as ‘‘Learning to use the L 
brary.’’ These are of minor importar 
however, when compared with the st 
ling worth of other parts of the |} 
One might search through many 
umes to find more ‘‘vitalized’’ sugyes 
tions on ‘‘ practical citizenship’’ and 
how to teach it than are given in C 
ter XII 


tl 


The chapter on ** The Us 


e Dictionary’’ is helpfully suggestiv 


The same thing is true of the discuss 
on ‘‘ Learning to Use the Library,’’ 

the chapter listing the various types 
educative seat-work, with plenty of 
planation for each, certainly should 
} 


a mine of ideas to the rural teache 
On the whole, this book brings pri 
tical suggestions in abundance to the: 
of the teacher most in need of them 
expresses a wholesome philosophy 
education fitted to her situation. It 
lifts and points to better things. It 
Spires, it encourages, it tempts 
teacher to try for greater perfection 
teaching, and makes for increasing dis 
satisfaction with the ‘‘ outgrown shells 


Yes, it deserves a place on the bookshelf 


of the rural teacher. 


E. L. RITTER 
Iowa State Teachers College. 
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Hr rSON, PERCIVAL WwW. 
Need for 


**Measuring the 
Western 
Survey 


Guidance in Penn 
Partial 


Prepared 


Directed 
Unt- 
Edu- 
115- 


svlvania—a 
for Publication,’’ 
Pittsburgh School of 
Journal, VI (May, 1931) 


and 
versity of 
cattor 
154. 

Contains three studies relating to vari- 
The author 
that the 
girls of the 


ous aspects of this problem. 


finds that guidance is needed; 


choices of both boys and 


upper and lower secondary schools are 
seriously in line with social needs as in- 
dicated by the present distribution of 


workers among 


occupations. 


KEELER, L. W. 
ii ffeect 
Accomplishment of Students Entering 


the College « 


An Investigation of the 


of Subject Deficiencies 


Upon 


if Engineering of the Uni 


versity of Michigan During the Aca 
demic Years, 1927-28, 1928-29, and 


1929-30.’’ Bureau of Educational Ref 
erence and Research Bull 


oS pp- 


tin, No. 


138 


finds that each succeeding 


} 


year shows an increased percentage of de 


ficiency, that the collective deficieney in 


trigonometry, geometry, and algebra is 


than that in 


the g 


cr mf r 
greater 


all other subjects, 
and that 
pron 


geometry, alge bra, 


rowth in deficiency is most 
need and consistent in the case of 


and physics. 


LANGVICK, MINA M ‘*Current Prac 
tices in the Construction of State 
Cc ses of Study,’’ United States De- 


partme t of the Interior Bulletin, No. 4 
1931), 84 pp. 


Contains materials legal 


relating to 


provisions which affect curriculum con 
struction, policies of state educational 
officials with respect to the publication 
and revision of state « irses of study, 
find s ecent state educational sur- 
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veys, in relation to the development of t 
curriculum, plans and techniques employed 
in the process of curriculum construction, @ 
for childre: , 
of elementary school age, and organiza 

the 


educational values desired 


tion of curriculum in relation 
working schedules and plans for pro } 


tion. 


EMIseE H. 


of Education in 


‘* Biennial Sur 
the United 
’ United States Depart 
of the Interior Bulletin, No. 20 (19 
38 pp. ) 


Contains an analysis of the situ 


MARTENS, 
States 


1928-1930,’ 


relating to exceptional children i: 

United States, state support and aut! 
zation of special classes, the supervis 
of special classes, 


city provisions 


exceptional children, county provisi 

for exceptional children, preparation of I 

teachers, mental hygiene, ete. 

ROGERS, JAMES FREDERICK. ‘‘ The Sp 
Defective School Child,’’ United St 
Department of the Interior Bullet 
No. 7 (1931), 31 pp. 

Discusses the kinds of defects of Spx 
found among school children and spe | 
work for speech defects, with a sumn 


and bibliography. 


LESTER, Kr 
‘*The Psychology 
Human Relationships—Individual 
Social: A Source Book,’’ Bullet 
the School of Education, Indiana 
versity, VII (March, 1931), 107 py 


SMITH, HENRY 


Levi McKINLEY. 


AND 


The readings are organized around 


following topics: (1) psychology ot 


individual: the individual as az 

human nature, and instincts and e! 

tions; psychology of social relations 
group behavior, and some _problet 

social relations; and psycholog 


and international relations 


national 
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HENRY LESTER, AND LITTELL, ) 10 \DMINISTI ION AND 
) The Philosophy of Human SUPERVISI 
s Individual and Collective AND SON. EAR W AND } I sen. R. H. 
e Book Bulletin of th Subjects Taught in High School, 
0 Education, Indiana Um Educational Research B P Ohio 
VII (January, 1931), 326 pp. State University, X (May 27, 1931 
ntains readings illustrating 283-289 
phy of human re lations im An analysis of 25 studies relating to 
‘ al times. Part 2 illustrates subjects taught by 98,464 high-scho 
sophy of human relationships as __te percentage of t 
political theory nationalism, e@ various subjects 
lism, cosmopolitanisn ma 
ral philosophy morality ; \xpERSON, H. J. ‘Correlation Between 
1 educatio Teac g 
Jo 
Mi { Study of the lI 99.99 
Behavior of a Group of I esults of this study show that the 
Children. University of slicthin: Ceteieete onaieal oe 
s, 1951, 4 Pp ment and teaching s ess are | 
f the unsupervised behavior 
f 46 institutional children Buct rR, MA \ A Study of Pupil 
lual differences were dis | nation in the New Have H 
the behavior of childre Boys Scho School Review, XXXIX (Se 
girls attacking and in being tember, 1931 532-541 
Girls surpassed boys im giv Ay nalvsis f the causes f , ] 
older group surpassé the eliminati as with recommendat s for 
gr in pattern | i t] mprovement of pupil = . 
’ ehavit h alealin 
E ARI ReEAVIS, W. C D Cox WARREN W Studv of the E 
‘eA St idy of ti Influenes mentary Scl | Teacher in New York 
rtmental Special m on the State,’’ I ersity of th State of 
al Attitudes of High-School Ne Yo Bulletin, N 97 J l, 
ward Certain Admuinistr 193] 19 vy 
, ems,’’ Bulletin of the De Contains data relating to the gener: 
t 0 Secondary-s¢ hool Pri C tra ng | fe ssi nal training teaching 
the National Education Assoct experience, and nationality of elementar) 
N 17 (May, 1951 70 pp. school teachers in the state of New York 
s aterial on the organ tior 
ulum, the size of the class FERGUSON, GEORGE O., JR ~ a I - 
to instruction, pupil failures in Predicting A lemic Suecess in the 
tion of the teacher in the class College f Arts and Sciences, Univer 
teacher rating, faculty meetings, sity Virgin U , of I 
i the distribution of the Rec i O S X\ 
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An analysis of the records of students 
at the University of Virginia from which 
the author concludes that, by excluding 
about 200 students of those now admitted, 
the total number passing on only six 
hours or less might be reduced by one- 
half. 


GARRETSON, OLIVER KELLEAM. ‘‘In- 
Service Training of Teachers in High 
Schools in Oklahoma,’’ School Review, 
XXXIX (June, 1931), 449-460. 

A questionnaire study of the super- 
visory practices of high school principals 
in the state of Oklahoma. 


Hawks, LENA JAMES. ‘‘Certain Rela- 
tionships Between Scholarship in High 
School and in College,’’ Johns Hopkins 
University Studies in Education, No. 15 
(1931), 58 pp. 

From an analysis of the records of the 
entering students of three universities 
and the relationship between marks in 
high school subjects and scholarship aver- 
ages in college, the author concludes that 
the relationship between marks in indi- 
vidual subjects in high school and first 
semester and first year scholarship in col- 
lege is .60; between the general high 
school average and scholarship in college 
is .70. 


Overn, A. V. ‘‘The Length of Service 
of Minnesota Teachers,’’ Elementary 
School Journal, XXXII (September, 
1931), 34-43. 

One thousand thirty-six teachers who 
began teaching in Minnesota in the 
school year 1919-20 were traced through 
their teaching service for a period of 
nine years. The percentages remaining 
in the teaching profession for the suc- 
cessive years were as follows: 100, 52, 
35, 26, 18, 14, 11, 6, 4. 
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REINHARDT, EMMA. ‘‘General Intro- 
ductory Courses in Education in Teach- 
ers’ Colleges,’’ Elementary School 
Journal, XXXII (September, 1931), 
57-66. 

A questionnaire study of introductory 
courses in Education as reported by 63 
teachers’ colleges. Such a course is re- 
quired in 41 of the colleges. 


Weurzin, J. Freperick. ‘‘ Authority of 
Normal-School Boards to Establish 
Teachers’ Colleges,’’ Elementary 
School Journal, XXXII (September, 
1931), 44-52. 

A legal study of the authority of 
normal-school boards. In general, it may 
be said that, although administrative 
boards have wide power and broad dis- 
cretion in the management and contro! of 
the institutions under their care, the 
power to make drastic changes, such as 
the creation of new schools, etc., must be 
expressly delegated, either by the con- 
stitution or by statute, or must be ex- 
tremely clearly implied. 


Wricut, Frank L. ‘‘A Comparison of 
College and University Graduates with 
Graduates of Teachers Colleges in 
Their Preparation as Prospective Sec- 
ondary Teachers,’’ Educational Ad- 
ministration and Supervision, XVII 
(September, 1931), 453-461. 

The author presents, from an analysis 
of the transcripts of high school and col: 
lege students graduating from different 
types of institutions, a summary of their 
training programs, 


EXPERIMENTAL STUDIES OF LEARNING 
AND TEACHING 

CHAPPELL, MATTHEW N. ‘Inhibition, 

Facilitation, Learning: Summation 

of Stimuli,’’ Psychological Review, 


XXXVIII (July, 1931), 317-331. 














RESEARCH 


er giving a critical analysis of the 


nhibition, facilitation, and learn- 


he author proposes that these vari- 


henomena are adequately explained 


; 


summation of stimuli. 


3, Grace. ‘The Relative Legibil- 
f Black Print and White Print,’’ 


of Applied Psychology, XV 
1931), 248-251. 


xperimental study of the relative 


ty of black and white type. The 


ity of black type on a white back- 


s 14.7 percent greater than white 
i black background. 

B 
D. **The Memory Span of Pre 
Children,’’ 


XXXIX 


ELIZABETH AND NEWMARK, 


Genet 


1931), 


Journal of 


June, 


0idgy, 


reviewing previous Investigations 
or reports the results of the mem- 
of 20 preschool children in a 


kindergarten in New York City. 


ithor finds that a Digit Backwards 


s too difficult for preschool children, 


at the 


tly 


ence, the e 


memory span for a Digits 
Test is a good test of general 
for 


and for 


rrelation abstract 


concrete 


being + 55, 


H. E. O ‘‘The Problem of 
’? British Jour 


In 
Psy 


nal of 


rence 


yy: General Section, XXII (July, 
31-42. 

notion of interference is used fre 

ly to explain certain phenomena of 

ng The author examines the 

asses of interference, and links it 
Pavlov’s work on inhibition. 

DONALD G., AND TINKER, 


A. ‘*Studies of Typographical 


ABSTRACTS 
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Factors Influencing Speed of Reading: 
VI. Black Type Versus White Type,’’ 
Journal of Applied XV 
(June, 1931), 241-247. 


Ps Uc holoa J. 


relative 


The re 


the 
merits of black and white type 
sults favor the black type. 


An experimental study of 


Vi 


Change of 


KATHERINE. ‘‘The Effects of 
Work the Work Decre 
ment,’’ Jowrnal of Experimental Psy 
chology, XIV (June, 1931), 218-241. 

This 


whether 


KERY, 


on 


determine 


there 


study attempts to 


under certain conditions 


exists a work decrement in two types of 
mental activity as shown by a cancella 
tion test and an equation test. No work 


decrement developed in the cancellation 
test, but a decided decrement developed 


in the equation test. 


WARDEN, C. J., AND COHEN, A. ‘‘ A Study 


of Certain Incentives Applied Under 


Conditions,’’ Journal of 


Psyc holoay, XX X I X 


er, 1951), 320-327. 


Schoolroom 
Genett« Septem 
! 
An experimental study of several types 
schoolroom ¢o1 


of ineentives used under 


ditions. The author finds that these in 
centives, while not especially effective as 
tar as speed was concerned, were effective 
n improving the accuracy seores of bot] 


boys and girls. 


PHYSICAL ADJUSTMENT, GUIDANCE, AND 
WELFARI 
HepGe, JOHN W., AND Hutson, PERC! 


VAL W. 

Guidance 
XXXIX 
The 


. 
‘dure and 


for Evaluating 
Revie 


, 508-519 


‘*A Techniqu 
Activities, ’’ 


September, 193] 


School 


describe a guidance pro 


the 


authors 


ce report results of a con 


parison of puy ils in 
September and May with their abilities, 


t the 


the aspirations of 


o determine whether 


later compari 
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sons represented closer relations than the 
former. 


VY CURRICULUM RESEARCH 


Davis, Ira C. ‘Analysis of the Sub- 
ject Matter in the Eight Most Widely 
Used Textbooks in General Science,’’ 
School Science and Mathematics. 
XXXI (June, 1931), 707-714. 

The author presents a topical analysis 
of the subject matter of eight widely used 
textbooks in general science. There is a 
high agreement in the textbooks for the 
units on air, water, heat, weather and 
climate, light, magnetism and electricity, 
energy and machines, plants, the human 
body, and foods; fair agreement in the 
units on sound, the solar system, and 
rocks and soils; and very little agree- 
ment in the units on animals and clothing. 


Kyte, George C. ‘‘Specifie Require- 
ments in the Two-Year Curricula for 
Training Elementary School Teachers 
in Representative Teachers Colleges 
and Normal Schools,’’ Educational 
Administration and Supervision, XVII 
(September, 1931), 401-416. 

An analysis of the requirements for 
two-year curricula for the training of 
elementary teachers indicating the fre- 
quency with which various courses are 
required in representative teachers col- 
leges and normal schools. 


WiLson, Howarp E., AND Erp, Bessie P. 
‘*A Survey of Social-Studies Courses in 
301 Junior High Schools,’’ School Re- 
view, XXXIX (September, 1931), 497- 
507. 

The authors present statistical data re- 
lating to the frequency with which courses 
in early American history, later Ameri- 
ean history, European background, an- 
cient history, world history, geography, 
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civies, Rugg’s fusion course, and local 
fusion courses, are offered in grades 7, 
8, and 9 of the junior high school. He 
finds little agreement in course require- 
ments. 


MEASUREMENTS, STATISTICS, AND METH- 
ODS OF EDUCATIONAL RESEARCH 


Downey, JUNE E. ‘‘Inverse Trends in 
the Pressey X-O Test and the Downey 
Will-Temperament Test,’’ Journal of 
Applied Psychology, XV (June, 1931), 
273-278. 

The author comments upon a recent 
article comparing the Downey Group 
Will-Temperament Test, the Pressey 
Cross-Out Tests, and the Brotemarkle 
Comparison Tests, pointing out that low 
coefficients of correlation do not neces- 
sarily invalidate her own or other tests 
of this group since they measure differ- 
ent traits. 


Meap, Cyrus D. ‘‘An Industrial Arts 
Lesson Seale,’’ Educational Adminis- 
tration and Supervision, XVII (Sep- 
tember 1931), 429-445. 

A quality seale for judging the merits 
of industrial arts lessons in the uppe! 
elementary and junior high school grades. 


OpELL, C. W. ‘Still More about Seor- 
ing Rearrangement or Continuity 
Tests,’’ School Review, XXXIX (Sep- 
tember, 1931), 542-546. 


A further discussion of methods of 
scoring continuity tests. 


PeaRSON, Econ 8. ‘‘The Test of Sig: 
nificance for the Correlation Co- 
effieient,’’ Journal of the American 
Statistical Association, XXVI (June, 
1931), 128-134. 
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) scussion of statistical procedures 
; 3 testing the significance of the co 
n { t of correlation. 


H. L. 


s of Recently Developed Theory of 


**Comments 


on Applica- 


~ Samples,’’ Journal of the 
ca Statistical 


‘VI (June, 1931), 


Association, 


150-158. 


\ scussion of a smal! 


theory of 


ONE, L. L. 
\ vysis,’’ P Re view, 
XVIII (September, 1931), 407-427 


‘Multiple 


Factor 
sychological 
thor presents a statistical pro 
r supplementing Spearman’s 
method of analysis to include 


er of general or group factors. 


** Rank 
hysieal Method,’’ 
ental Psychology, 


7-201. 


Order as a 
Journal of 


XIV (June, 


evelopment of a statistical pro 


a shorter method of applyin; 
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MISCELLANEOUS 


PETERS, CHARLES C., AND Struck, F. 


THEODORE. ‘‘ Abstracts of 
Edueation,’’ Penn State 


Education, No. 2 (1931 


An abstract of some thirty-eight mas- 


Studies in 
Studies im 


, 96 pp. 


ters’ and doctors’ dissertations prepared 
by students of Pennsylvania State 
College. 

éé } 


Proceedings of the Seventh 


Annual 
Educational Bulletin of 


School Service, College 


~ 


Conference,’ 
the Bureau of 
of Edueation, University of 


IT] 


Kentucky, 


(December, 1930), 100 pp 


Contains addresses by Hamilton Holt, 
Washburne, Thomas H. 


Donovan, and others. 


Carleton 


H. L. 


Briggs, 


NEW TESTS 


MEIER, NORMAN CHARLES, AND SEASHORE, 


CaRL EMin. Meier-Seashore Art Judg- 
ment Test. Iowa City. Iowa: Bureau 


Research 


of Educational 
1931. 


and Service, 


The test is designed for use primarily 


in junior and senior high schools, and in 


art schools. 
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Address all research news and communications to Editor 
Carter V. Good, Teachers College, University of Cincinnati, 


RESEARCH NEWS and COMMUNICATIONS © 
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: 


Request for Titles of Ph.D. Theses 
Under Way.—The Journal of Educa- 
tional Research expects to publish each 
year in the January number a list of 
dissertations under way in 
education. This practice was inaugu- 
rated in the January, 1951, number when 
587 titles were listed, accompanied by a 
topical index. Invitations to codperate in 
the compilation of the list of Doctors’ 
studies under way during the present 
school year have been sent to the follow- 
Boston, Chieago, Cali- 
University, Columbia, 
Washington, Harvard, 
Iowa, Johns Hopkins, 
Kentucky, Michigan, Minne- 
New York, Ohio, Ore- 
gon, Peabody, Pennsylvania, Pittsburgh, 
Southern California, Stanford, Texas, 
Washington, Wisconsin, and Yale. 


the Doctors’ 


ing institutions: 
Catholic 
George 
Indiana, 


fornia, 

Cornell, 
Illinois, 
Kansas, 


sota, Missouri, 


If the reader is aware of other gradu- 
ate institutions which have under way 
theses in education, please send 
such information to the editor of this 
department, or feel free to have the im- 
stitution forward a list of its Doctors’ 
studies without a direct invitation from 
the editor. 


Doetors’ 


Educa- 
Character education is the subject 

1932 yearbook of the Department 
The commission 
which is preparing it is composed of the 


1932 Yearbook on Character 
tion.- 
of the 


of Superintendence. 


following people: 


Bertie Backus, principal, Powell Junior 
High School, Washington, D. C, 

George 8. Counts, associate director, In 
ternational Institute, Teachers College, 
Columbia University. 

Frank N. Freeman, professor of educa 
tional psychology, University of Chi- 
cago. 

C. B. Glenn, superintendent of schools, 
Birmingham, Alabama. 

Paul T. Rankin, supervising director, de 
partment of research and adjustment, 
Board of Edueation, Detroit. 

Belle M. Ryan, assistant superintendent 
of schools, Omaha, Nebraska. 

Goodwin Watson, associate professor of 


education, Teachers College, Columbia 
University. 

David E. Weglein, superintendent of 
schools, Baltimore, Maryland. 


A. L. Threlkeld, superintendent of 
schools, Denver, Colorado, Chairman. 
The commission is assisted by 8S. D 

Shankland, executive secretary of the 

Department of Superintendence, John K 

Norton and Margaret Alltucker Norton. 

until recently head and member respec 

tively of the department of research, Na- 
tional Education Association. 

The chapters of the yearbook, as 
planned to date, are as follows: 


1. Analysis of American Life from the 
Viewpoint of Character Education 


2. Agencies of Character Education 

5. Objectives in Character Education 

4. Theories of Character Edueation 

5. Tests and Measurement in Character 
Edueation 

6. Review of Research Studies in Char- 
acter Edueation 

7. How the Currieulum Content and 


Method May Contribute to Charac- 
ter Education 
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Sz 


tribute to Character Education 
How the Life of the School May 
Contribute to Character Education 


( 
8. How Classroom Procedure May Con- 
| How Individual Counseling May Con- 


IRE HE BOE BE HE BOE BOE 


” tribute to Character Education 
11. The Teacher in Character Education 
12. Organization of a School System in 
©} t Relation to Character Education 
The Administration of a School Sys- 
lunior ; tem in Relation to Character Edu- 
‘ eation 
r, Ir 14. Home and School Coéperation 
leg q 15. The Relation of the School to Other 
' Organizations and Institutions in 
du 4 Charaeter Education 
Cc |= 1¢@ purpose of the yearbook is to 
hool | stimulate thought on the subject of char- 
education rather than to attempt to 
r. de resent any specific program for the 
m Ss ls to follow. To make statements 
’ lefinite enough to accomplish this ob- 
on j tive without seeming to place undue 
~— B sanction upon specific theories, pro- 
mi } cedures, and the like, is a difficult task, 
this is what the commission is at- 
t 
ting 
rt 
. Survey of the Dental Curriculum.—For 
_D some years many teachers of dentistry 
; e felt the need for a systematic study 
nk. | analysis of the dental curriculum. 
* Curriculum content and its arrangement 
been much discussed. Several na- 
~ i tional organizations have outlined eur- 


lums or specified certain requirements 
rating purposes, but no general 
creement has been reached as to what 
stitutes adequate training for the 
tice of dentistry and how that train- 

: can best be given. Like the eurrieu- 


= Ss in most other professional fields, 


ol the dental curriculum has grown by ac- 
act retion from time to time without thor- 


revision of the whole. 
\mong the forty three dental schools 
the United States and Canada, there 
irs sa considerable difference of opinion re 


ling the pre-dental requirements and 





the content and length of the dental cur- 
riculum. A number of different schemes 
for the undergraduate curriculum, such 
as the two-three plan, the one-four plan, 
and the two-four plan, are in operation, 
leading to embarrassment and confusion. 
The comprehensive Report on Dental 
Education made by the Carnegie Foun- 
dation for the Advancement of Teach- 
ing in 1926 eriticized the dental cur 
riculum and recommended the adoption 
of a requirement of at least two years 
of suitable pre-professional college work 
and a reorganization of the undergradu 
ate dental curriculum, but it included no 
thorough analysis of curriculum content. 

To correct these confusing conditions, 
the American Association of Dental 
Schools in 1929 decided to make a survey 
of the dental curriculum. The Associ 
ation was granted $20,000 by the Car- 
negie Corporation for financing the sur- 
vey. The following committee to have 
charge of the project was appointed: 
Wallace Seccombe, University of Toronto, 
Chairman; John T. O’Rourke, Univer- 
sity of Louisville, Secretary-Treasurer ; 
Arthur D. Black, Northwestern Univer 
sity; H. Edmund Friesell, University of 
Pittsburgh; and Harry M. Semans, Ohio 
State University. Floyd W. Reeves of the 
University of Chicago and W. W. Char- 
ters of Ohio State University were se- 
lected as technical advisers to the com 
mittee. L. E. Blauch has been appointed 
Executive Secretary to devote full time to 
the work of the survey. The office of the 
Executive Secretary is located in the 
Northwestern University Dental School. 

The committee proposes to ascertain 
the requirements for dental health ser- 
vice and to determine the knowledge and 
skill which should be possessed by the 
dentist properly to render this service. 
The committee hopes it may be possible, 


at the conclusion of the study, to recom- 
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mend a curriculum which will prepare 
adequately the undergraduate for dental 
practice, including the development of 
character, an appreciation of the human- 
ities, and a scientific outlook which will 
assure the graduate’s interest in dental 
research. The study does not include 
curriculums for post-graduate work or for 
the training of specialists in dentistry. 
Rather, it is concerned with the training 
of general dental practitioners to render 
adequate dental health service in rural 
as well as urban centers. The findings 
of the committee will be reported to the 
American Association of Dental Schools 
previous to publication and will be sub- 
ject to the approval of the Association. 


Educational Research at Ohio State.— 
The Bureau of Educational Research at 
the Ohio State University, founded in 
1922 by B. R. Buekingham and now un- 
der the direction of W. W. Charters, is 
composed of seven units. 

Three of these seven units are devoted 
primarily to service, although various re- 
search projects also are carried on by 
them. These three service units are as 
follows: 

1. The Reference Division, which con- 
tains the Reference Library, of 
which Mary Rebecea Lingenfelter 
is in charge. 

2. The Editorial Division, under the 
direction of Josephine MacLatcehy. 

3. The Appointments Division, which 
is the University teacher placement 
agency, and is directed by Earl W. 
Anderson. 

Research is the major function of the 
four remaining units of the Bureau, 
which are as follows: 

1. The Division of Buildings and 
Grounds, directed by T. C. Holy, 
who also is associated with the 
Ohio State Department of Edu- 
eation. 

The Division of Achievement Tests, 
under the direction of Ralph W. 


Tyler. 


to 








3. The Division of College Curriculum, 

in charge of Edgar Dale. 

4. The Division of College Personnel, 

of which W. H. Cowley is director. 

The senior staff listed above is aided 
by five research assistants and a junior 
staff consisting of clerical and _ secre- 
tarial workers. The Bureau occupies 
space in the Education Building, which 
also houses the administrative offices of 
the College of Education, offices of its 
various departments, and the Education 
Library. 

Some of the more important projects 
may be listed. The Division of Build- 
ings and Grounds assists school boards 
wishing to initiate building programs by 
making surveys for them and, in addi- 
tion, conducts numerous school surveys 
for research purposes. 

The Division of Achievement Tests is 
coéperating with some fourteen depart- 
ments on the campus in an effort to im- 
prove existing types of tests and exami- 
nations. Enlargement of this program 
in the fields of botany, zoology, and chem- 
istry has been made possible by a grant 
from the American Council of Education. 

The College Curriculum Division is as- 
sisting in coéperative curriculum revi- 
sion programs in the College of Veteri- 
nary Medicine and the College of Edu- 
eation. It also is coéperating with the 
State Director of Health and Physical 
Education in a study of pupil interests 
in the field of health. 

The head of this Division and P. W. 
Holaday during this year are engaged in 
motion-picture research under the diree- 
tion of the Committee on Educational Re- 
search of the Payne Fund of New York 
City. Dr. Holaday is making a study 
of the retention of motion-picture content 
by children, while Dr. Dale is analyzing 
the content, studying the attendance of 
children, and initiating a project designed 
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to raise children’s standards of taste in 


October, 


motion pictures. 
The 
vorking with other groups in an evalua- 


College Personnel Division is 


tion of freshman week, a survey of the 


juarter system as opposed to the semester 
system, and various studies regarding 
eulty contact with students. 
Two annual conferences are directed by 
embers of the Bureau staff—the Edu- 
eation Conference, under the direction of 
Dr. Cowley, and the Institute for Educa- 
tion by Radio, of which Dr. Lumley is 
executive officer. In connection with 
latter, a course in education by radio 
s given during the summer quarter. A 
recent addition to the Bureau is a radio 
init, headed by Hillis Lumley, which has 
as its objective, research in this field. 
The proceedings of the two conferences 
are published annually by the Editorial 
Division, directed by Miss MacLatehy. 
‘*Edueation on the Air,’’ the proceed- 
gs of the 1930 Institute for Education 
by Radio, had the honor of being listed 
among the starred books in the sixty best 
edueational publications of 1930. In ad- 
dition to these two volumes, the Bureau 
iblishes the Journal of Higher Educa- 
tion and the Educational Research Bul- 
tin. A 
graphs also is issued, the latest contri- 


series of educational mono- 
bution in this area being a study of the 
Bing Law. 

Although most of the time of the staff 
members is devoted to research, each is 
Their total 


teaching load amounts to forty-five hours, 


ching at least one course. 


the time of one and one-half full pro- 
essors distributed among the eight staff 
members, 

The Reference Library prepares bib- 
liographies and places at the disposal of 
the Bureau staff a collection of research 
the field of education. It 
maintains a complete exhibit of current 
elementary- and secondary-sehool text- 


material in 
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books, and of achievement tests. This 
material is used not only by the Bureau, 
the 


the 


but by other research workers on 


faculty, graduate students, and 


schools of the state. 


Organization of Educational Research 
at the University of Chicago.—Beginning 
with the Autumn Quarter, 1931, the De- 
partment of Education of the University 
of Chicago will give a new type of ad- 
vanced research course. Instead of reg- 
istering students for any research prob- 
lem in which they are interested, each in- 
structor has announced the problem on 
which he will be working constructively 
during the quarter in which the course 
is given. For example, W. C. Reavis will 


carry on intensive research concerning 


‘*The Committee Organization of Boards 
of Education;’’ G. T. Buswell 
ganize critical experiments on the con 


will on 


stancy of eye movement habits and the 


relation of pheneloscope records of 
rhythm and pronunciation in reading to 
photographie records of eye movement; 


K. J. 


study in statistics with special applica- 


Holzinger will carry on advanced 


tion to the problem of the factor theories 
of mental abilities; and W. 8. Gray will 
carry on a series of critical studies and 
investigations of the nature of the read- 
ing activities required in studying sec- 
ondary-school The 
who register for these and other similar 
with the in- 


subjects. students 


courses will participate 
structor in the various steps and stages 
of the studies which he is pursuing. It 
is hoped through participation in research, 
under the guidance of an expert in a field, 
students may acquire keener insight into 
the problems of research and make more 
rapid growth in acquiring efficiency in 
research activities, 


Philadelphia Research.—Six years ago, 
upon recommendation of the superintend- 
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ent of schools, The Board of Public 
Edueation of Philadelphia created a Di- 
vision of Educational Research. The 
functions of this division are to coérdi- 
nate, extend, and direct research activi- 
ties within the system to the end that 
reliable data may be available upon 
which to base the educational policies of 
the superintendent and his assistants. 
The division has gradually extended its 
activities to the point where professional 
stimulation and guidance have been af- 
forded to all teachers and principals. 
The data gathered by the division have 
been utilized so as to bring about a more 
successful classification of pupils, and to 
introduce a diagnostic analysis of pupil 
performance upon which more effective 
teaching may be based. Analyses of age- 
grade status and of promotion rates 
within the system have led to adminis- 
trative adjustments which result in more 
regular and satisfactory progress of 
pupils through the grades. Careful con- 
sideration of the wide variations in abil- 
ity and achievements shown by the pupils 
of a given grade have directed attention 
to the importance of the adjustment of 
school requirements to the capacities and 
needs of pupils. Thus definite progress 
has been made toward individualized in- 
struction and specific teaching. 

The results of research activities 
throughout the system are recorded in 
the inereased achievements of pupils re- 
vealed by the application of objective 
educational measurements. In a series 
of mimeographed and printed bulletins, 
the division has, from time to time, pre- 
sented definite evidences of improvement 
in pupil achievement. These reports also 
direct attention to increased uniformity 
in interpretations of the several courses 
of study and to the desirability of re- 
medial teaching in certain specifie phases 
of school work. Thus, each year’s 
progress has been built upon the achieve- 





JOURNAL OF EDUCATIONAL RESEARCH 





[Vol. 24, No.3 


ments of the preceding year with both 
teachers and pupils growing more suc- 
cessful in their work as it comes to be 
based upon clearly defined goals anj 
measured progress toward their achieve- 
ment. 

In addition to general research stimu- 
lation and guidance throughout the sys- 
tem, the division has pursued a number 
of projects which have furnished the 
superintendent with objective data upon 
which to make recommendations for the 
improvement of administrative policy. 
These studies have been concerned with 
such subjects as curriculum construction, 
teachers’ salaries, teaching load in high 
schools, the efficiency of operation of cer- 
tain school units, the measurable im- 
provement of pupils in the command of 
oral and written English attained during 
the four-year high school period, and the 
desirable extent of individualization of in- 
struction as represented in ability group- 
ing, in individual assignment sheets, an/ 
in the establishment of special classes. 

An important phase of the work of the 
division is that of objective test construc 
tion. It is desirable that such tests be 
definitely representative of the several 
courses of study in order that the results 
of their administration may direct the in- 
terpretation of these courses or indicate 
the need and character of revisions that 
may aid teachers and pupils in the more 
effective achievement of specific goals. 
An extensive range of tests is now avail- 
able covering the requirements of most 
of the subjects in all Grades from I to 
XII. 

A plan of standard scores has been 
developed which will aid teachers ané 
principals in the interpretation of test 
scores and in the comparison of pup! 
performance on tests in different subjects 
and at different periods throughout the 
year. The division is now experimenting 
with a plan of ‘‘ability standards” 
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an adjustment may be made for 
pupil on a basis of his measured 
ty to perform in the work of the 
In this way, it will be possible 

g about an individualization of in- 

the 
etition of one pupil with another 


tion which will avoid unfair 


substitute for it a more stimulating 


etition with one’s own past achieve- 


he division is continuing its long-term 
ental study of the effects of abil- 


grouping. Sufficient progress has 
ade in the control of conditions 

‘ inding the study to warrant a two- 
research program in an effort to 

re objective measurement of the re- 

Its of this plan of administration. An- 
experimental study is directed 


measuring the effects of the ap- 
n of the new course of study in 
ling in IV to VI. Still an- 


project is the discovery and report- 


Grades 


g of methods of teaching and drill em- 
1 in schools whose pupils show, for a 
term, exceptionally good progress 

he command of the fundamental op- 
ns in arithmetic. Extensive admin- 

strative studies are being made of teach- 
g id in senior high schools and of 
extent of provision for individual in- 
struction. 
The division staff is made up of a di- 
tor, Philip A. 


and 


Boyer, five professional 


clerical assistants. 


ssistants 


nine 
the professional assistants have 
One of 


lireets attention solely to the field 


ik of special assistant. 


ndary education, and the other to 
t of Three as- 
In 


ion to aiding in the research work 


elementary education. 


“stants are ranked as supervisors. 


he division, these supervisors visit 
pals and give assistance in the con- 
of group 
and in the analysis and interpreta- 
Upon the basis of these 


and administration 


Str tion 


of results. 
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analyses, remedial procedures are devel- 
oped that have specific application to the 
particular problems in hand. In this 
way, the division is endeavoring to rec- 
ognize and render assistance in the solu- 
tion of the peculiar problems of different 
local and school communities. 

The the 


pendent activities of the schools by mak- 


division cooperates in inde- 
ing available as reference material the 
technical research data it has assembled. 
The staff of the division gives advice and 
assistance and on occasion coéperates in 
carrying out a project that seems to have 
important implications for improvement 
in some phase of school work. Increas- 
ing numbers of teachers and principals 
seek the resources and advice of the di- 
vision as aids in solving teaching and 
Thus, 
portant activity of the division concerns 
itself 


the research 


supervisory problems. an im- 


with supporting and stimulating 
attitude among teachers and 
principals by providing reference mate- 


rial and coéperating in individual re- 
search projects. 

The projects of the division are varied 
in character and scope. Some activities, 
such as the experiment in ability group 
ing, extend over long terms. Others are 
continuous, such as the analysis and in- 
terpretation of promotion rates. Still 
others are periodic, such as the diagnosis 
of pupil difficulties at the beginning of a 
term or the survey of the results of in 
struction at the close of a term. In ad- 
to 


projects assigned by the superintendent, 


dition these, there are incidental 


indi- 
the 


practice of the division to make special 


or suggested by the problems of 


vidual teachers or principals. It is 


report in printed or mimeographed form 
of the results of research projects that 
have wide application. These bulletins 
are made the subjects of professional dis 
cussions among superintendents, princi- 


pals, and teachers. 
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California State Division of Research 
and Statistics—The Division of Re- 
search and Statistics is concerned pri- 
marily with the administrative and ser- 
vice activities of the state department of 
education. It is essentially an adjunct of 
the office of the superintendent of public 
instruction, performing many functions 
legally allocated to this office, and having 
delegated to it many activities of admin- 
istrative character with relation both to 
the state department and the development 
and execution of general policies for the 
state school system. 

The functions of the Division, of which 
Walter E. Morgan is director, may be 
classified under four heads: adminis- 
tration, research and statistics, service, 
and coérdination. The development of 
these functions in carrying on the activi- 
ties of the Division in relation to the re- 
mainder of the state department of edu- 
eation and the public-school system de- 
termines the specific activities and the 
program for 1931. 

Responsibility for such clerical-admin- 
istrative activities as the apportionment 
of state school funds with prescription of 
record and report forms and_ blanks, 
auditing of annual reports, and prepa- 
ration of statistical data for the depart- 
mental reports continue as the primary 
functions. In this capacity, the Division 
exercises a purely clerical-administrative 
capacity as an adjunct to the office of 
the superintendent of publie instruction, 
with only an indirect relationship to the 
state school system. 

The research and statistics function re- 
quires the continued development of tech- 
niques and methods for the presentation 
of significant data relative to the state 
school system, and ealls for expanded in- 
terpretation of the data collected and 
presented, together with an extension of 
specialized and localized studies applied 
to selected types of problems. 
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The service functions will be expandej 
in order that more definite and specific 
services may be extended to the super 
intendent and to the state department, as 
well as to the school officers throughout 
the state school system. This phase of 
the Division’s responsibility requires ex- 
pansion more than any other at the pres- 
ent time. 

The coérdination function relates to 
both the activities of the several divi- 
sions of the state department and to re- 
lationships with school officers throughout 
the state. More numerous and more ef- 
fective efforts can be made in providing 
closer coérdination of the various activi- 
ties which impinge upon those of the 
Division. 

In 1931, the program involves specific 
projects under each of the four major 
functions. 

Clerical-administrative projects are: 

1. Continuance of regular activities 
such as apportionment of school funds, 
auditing of reports, ete. 

2. Continued simplification and co- 
drdination of all record and report forms 

3. Development of standardized recor! 
and report forms for the purpose of es 
tablishing greater uniformity in data col- 
lected. This includes such basie forms 
as the school district budget, school war 
rants, and classifications of school ex- 
penditures. 

4. Standardization of fiscal pro 
cedures for schools, including the rout 
ing of school warrants and unified con- 
trol of records of school funds. 

These projected activities are primarily 
for the purpose of giving closer definition 
and uniformity to the basie records fron 
which official reports are made to the 
office of the superintendent of public in 
struction. This will serve to improve the 
value of statistical data from the point 
of view of the state department as well 
as from that of the state school system. 

Projected activities in the field of re 
search and statistics include: 














Es 


K 


ntinuance of present general and 
tabulations of statistical data; 
on with members of the depart 
1 school officers in the field in 
g and compiling specialized types 
coéperation with candidates for 
legrees in gathering and compil- 

in studies of state-wide signifi- 
nd interpretation of data as ap- 

alized or specialized situations. 
tablishment of a eard file of ab 


of research studies completed in 


ia and elsewhere, the abstracts to 
loped in ecoéperation with Phi 
appa and to be made available 
rtmental staff members and to 


officers upon request. These ab- 


1? 


will be classified and filed in such 


Operation with city s 


as to make them readily ser 


iperintend 


ts in establishing at Sacramento a re 


ordinator to serve city districts 
ing together results of adminis 
studies, coérdinating research 
and making available for the 
ty superintendents con posite 
f such studies. This will be de 

cooperation with the Associa 


Publie School Superintendents 


tension of endeavors to eoérdi 


earch activities throughout the 
1 to develop coéperative attack 


st arch problems. 


pletion of numerous special 


elating to secondary schools for 


d publications of the department. 


yperation with staff members in 
g statistical summaries for ref 
urposes similar to the ecard sum 


of data from the 1930 annual 


liy 
n 


peration with staff members in 


g information, criticizing forms 


juestionnaires, ete. 


Pri 


vision of a publication reference 


whereby all publications coming 


the ad 
s 

Cor 

sent 


livision will be referred to staff 


interested 
peration with school officers by 
ing the state department in con 


, giving addresses. ete 


duet of special investigations on 
neluding surveys in the field 


vide interpretations of data 
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upon request from staff members or from 
officers in the field. 

Increasing stress will be placed on the 
service function, which will be developed 
as the primary objective of the Division 
in terms of importance and value to both 
the department and the public-school 
system. 

The coérdination and integration fune 
tion should embrace activities designed 
for the purpose of codrdinating and in 
tegrating the activities within the de 
partment itself, relations between the 
department and the officers in the 
field, activities, programs, and policies 
throughout the state school system. Ser 
vice on state-wide committees, direction 
given to committees and groups in tl 
field, and interpretative service to staff 
members should comprise the major as 
pects of activities in this field. In con 
junction with this program, there will be 
developed a program of publication 
which ineludes: 

1. Publications at present established 
and being issued, such as the biennial 
report data, statistics of city school dis 
tricts, junior-college statistics, directories, 
special analysis from October reports, and 
special studies in California schools 

2. Special studies, interpretative and 
statistical, applying to localized sit 
tions or specialized problems ; e. g., con 
parative data for selected cities and high 
schools, or relating to such problems as 
teachers’ salaries, school finance, ete. 

3. Complete analysis of public-school 
finance. 

4. Bulletin o 
California. 

5. A bulletin on California secondary 
education. 

6. Gists of the state school code. 

7. Application of an _  equalizatior 
fund plan to the school districts of 


te 


public education in 


alifornia. 


An activity which might be classified 
under the function of coérdinatio1 ! 


integration, but which probably is related 


to all functions of the Division, is that 


of codperation in the development of k 
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islative recommendations for the state de- 


partment. Such recommendations are 
concerned with clarification of the school 
code and the drafting of bills relative 
to school finance and organization and 
Related to this activity, 
part of the 


coérdination function, is a project to de- 


administration. 
and perhaps properly a 
velop throughout the state more uniform 
observance and interpretation by public- 
school officers of the state laws relating to 


public-school finance. 


Bureau of Educational Measurements 
Unwersity of North Dakota.—The 


primary purpose of the Bureau is to give 


at the 


assistance in the measuring and inter 
preting of the results of teaching in the 
schools of the state, to collect and tabu- 
late the 


+} 


the schools, and to assist in any way pos 


results of educational tests in 


sible in testing programs. During the 
Bureau has published a 
entitled Achieve 
ment in North Dakota City, Town, and 


Rural Schools.’’ This 


past 


bulletin 


vear, the 


‘* Edueational 


bulletin contains 
the results of testing with the New Stan 
ford Achievement Tests in the state. A 
few copies still are available for general 
distribution. During the next year it is 
planned to issue a similar bulletin which 
will give the results on other standardized 
tests which have been given in the schools. 

Another project of the Bureau is the 
workbooks 


including first-year 


evaluation of in the various 
subject-matter fields, 
algebra and geometry. 
The director of the Bureau, Robert D. 
Cole, has been working in close collabora- 
tion with the state department of educa- 
tion in the improvement of eighth-grade 
examinations for rural schools and in the 
preparation of tests in the various high- 
schools. 


school subjects for unclassified 


It is probable that he also will take over 
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the supervision of the examinations given 
by the state department of education. 


Research in the Utah State Department 
of Education. 
two, the Utah State Department has ex- 


During the last year or 


tended the service of its several divisions 


to include the survey of a number of 


school districts. One of these reports is 
a survey of the Duchesne County schools, 
which is a typical rural district in Utah, 
A survey similar to the Duchesne study 
is being conducted by the staff in Rich 
county at the present time. It is likely 
that the report of the Rich County sur- 
vey will be mimeographed and available 
systems and edu- 
Other 


for interested school 


eators during the current year. 


smaller surveys have not been printed. 
During recent years, the department 
has conducted a testing program among 


all the high schools of the state. The 


testing program in 1930 included the 
following subjects: English grammar, 


English composition, physics, and chem- 
The 


tests were given to all members of the 


istry. grammar and composition 


graduating class in the public high 


schools. The physics and chemistry tests 
were given to all pupils enrolled in those 
May, 1930. Standardized 


tests were used in grammar, physics, and 


subjects in 
chemistry. In measuring English compo 
sition, all seniors were required to write 
compositions which were graded by the 
English faculty of the state university. 
The tests in the other subjects were scored 
in the state department office under the 
direction of the staff. 

During the recent years, the state de 
partment also has given tests to the fifth, 
sixth, seventh, eighth, and ninth grades 

main sub- 
The scoring 


of the papers has been done by the local 


throughout the state in the 


jects taught in these grades. 


school people. 








